[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:43 dist-test-slave-n45k krb5kdc[25343](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:43 dist-test-slave-n45k krb5kdc[25343](info): set up 2 sockets
Sep 28 20:14:43 dist-test-slave-n45k krb5kdc[25343](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260928 20:14:44.098397 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:44Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:44.218098 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:45517
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:45517
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:44.301817 25356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:44.302064 25356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:44.302102 25356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:44.303333 25356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:14:44.303403 25356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:44.303429 25356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:44.303462 25356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:14:44.303488 25356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:14:44.304953 25356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:45517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:45517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:44.305234 25356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:44.305469 25356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:14:44.310613 25356 server_base.cc:1034] running on GCE node
W20260928 20:14:44.310568 25362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.310618 25361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.310568 25364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:44.311115 25356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:44.311429 25356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:44.312605 25356 hybrid_clock.cc:648] HybridClock initialized: now 1790626484312602 us; error 37 us; skew 500 ppm
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:44.315316 25356 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:14:44.315843 25356 webserver.cc:460] Webserver started at http://127.24.190.62:43901/ using document root <none> and password file <none>
I20260928 20:14:44.316076 25356 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:44.316151 25356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:44.316313 25356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:44.317461 25356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "cb27f5b5ddb343babd7406b9aebda673"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "43b92b683bfd426fcc7c760a1fc8ee63"
server_key_iv: "ca23439d798a3f7a5052c0e073617d00"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.317847 25356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "cb27f5b5ddb343babd7406b9aebda673"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "43b92b683bfd426fcc7c760a1fc8ee63"
server_key_iv: "ca23439d798a3f7a5052c0e073617d00"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.319314 25356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:14:44.320271 25371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.320529 25356 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:44.320647 25356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "cb27f5b5ddb343babd7406b9aebda673"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "43b92b683bfd426fcc7c760a1fc8ee63"
server_key_iv: "ca23439d798a3f7a5052c0e073617d00"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.320727 25356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:44.328938 25356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:44.331378 25356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:44.331547 25356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:44.335798 25356 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:45517
I20260928 20:14:44.335834 25423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:45517 every 8 connection(s)
I20260928 20:14:44.336184 25356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:14:44.337049 25424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:44.339409 25424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673: Bootstrap starting.
I20260928 20:14:44.339922 25424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:44.340210 25424 log.cc:824] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:44.340890 25424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673: No bootstrap required, opened a new log
I20260928 20:14:44.342739 25424 raft_consensus.cc:348] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb27f5b5ddb343babd7406b9aebda673" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45517 } }
I20260928 20:14:44.342878 25424 raft_consensus.cc:374] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:44.342901 25424 raft_consensus.cc:729] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cb27f5b5ddb343babd7406b9aebda673, State: Initialized, Role: FOLLOWER
I20260928 20:14:44.342968 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 25356
I20260928 20:14:44.343081 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:14:44.343052 25424 consensus_queue.cc:260] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb27f5b5ddb343babd7406b9aebda673" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45517 } }
I20260928 20:14:44.343127 25424 raft_consensus.cc:388] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:14:44.343171 25424 raft_consensus.cc:482] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:14:44.343222 25424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:44.343715 25424 raft_consensus.cc:504] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb27f5b5ddb343babd7406b9aebda673" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45517 } }
I20260928 20:14:44.343739 25336 external_mini_cluster.cc:1428] Setting key 6993014211d76845e6565c2035e2c449
I20260928 20:14:44.343832 25424 leader_election.cc:302] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cb27f5b5ddb343babd7406b9aebda673; no voters:
I20260928 20:14:44.344029 25424 leader_election.cc:288] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:14:44.344048 25427 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:44.344157 25427 raft_consensus.cc:686] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [term 1 LEADER]: Becoming Leader. State: Replica: cb27f5b5ddb343babd7406b9aebda673, State: Running, Role: LEADER
I20260928 20:14:44.344301 25424 sys_catalog.cc:564] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:14:44.344290 25427 consensus_queue.cc:237] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb27f5b5ddb343babd7406b9aebda673" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45517 } }
I20260928 20:14:44.346504 25429 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cb27f5b5ddb343babd7406b9aebda673" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb27f5b5ddb343babd7406b9aebda673" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45517 } } }
I20260928 20:14:44.346565 25429 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:44.346354 25428 sys_catalog.cc:455] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cb27f5b5ddb343babd7406b9aebda673. Latest consensus state: current_term: 1 leader_uuid: "cb27f5b5ddb343babd7406b9aebda673" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cb27f5b5ddb343babd7406b9aebda673" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45517 } } }
I20260928 20:14:44.346741 25428 sys_catalog.cc:458] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673 [sys.catalog]: This master's current role is: LEADER
W20260928 20:14:44.346870 25443 catalog_manager.cc:1558] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:14:44.346947 25443 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:14:44.347038 25445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:14:44.347205 25445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:14:44.350458 25445 catalog_manager.cc:1347] Generated new cluster ID: edc6847b69d24e40bd156566dab29970
I20260928 20:14:44.350522 25445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:44.360077 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.344681 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52128 (local address 127.24.190.62:45517)
0928 20:14:44.344876 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:44.344886 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:44.345275 (+ 389us) server_negotiation.cc:407] Connection header received
0928 20:14:44.347729 (+ 2454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:44.347736 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:44.347794 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:44.347942 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:44.350020 (+ 2078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.351353 (+ 1333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.352493 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.352914 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.353032 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.356452 (+ 3420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:44.356456 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:44.356456 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:44.356470 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:44.358163 (+ 1693us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.358637 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.358640 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.358641 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.358734 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.359018 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.359018 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.359019 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.359257 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:44.359427 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:44.359697 (+ 270us) server_negotiation.cc:299] Negotiation successful
0928 20:14:44.359843 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":91,"threads_started":1}
I20260928 20:14:44.363325 25445 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:14:44.363864 25445 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:14:44.375464 25445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cb27f5b5ddb343babd7406b9aebda673: Generated new TSK 0
I20260928 20:14:44.375674 25445 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:14:44.409765 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45517
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:44.515483 25450 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:44.515753 25450 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:44.515784 25450 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:44.516932 25450 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:44.516968 25450 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:44.516994 25450 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:14:44.518448 25450 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45517
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:44.518661 25450 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:44.518839 25450 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:44.524075 25455 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.524124 25456 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.524123 25458 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:44.524385 25450 server_base.cc:1034] running on GCE node
I20260928 20:14:44.524595 25450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:44.524940 25450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:44.526094 25450 hybrid_clock.cc:648] HybridClock initialized: now 1790626484526082 us; error 50 us; skew 500 ppm
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:44.528754 25450 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:14:44.529208 25450 webserver.cc:460] Webserver started at http://127.24.190.1:42811/ using document root <none> and password file <none>
I20260928 20:14:44.529397 25450 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:44.529438 25450 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:44.529526 25450 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:44.530575 25450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "f0ac2cb643364a37966445586fe0a8df"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "07620fd339948e86260802252c6e7f9b"
server_key_iv: "6364ddd8186db4ccdfbda4c8d2d71981"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.530876 25450 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "f0ac2cb643364a37966445586fe0a8df"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "07620fd339948e86260802252c6e7f9b"
server_key_iv: "6364ddd8186db4ccdfbda4c8d2d71981"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.532159 25450 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:44.532888 25465 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.533056 25450 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:44.533156 25450 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "f0ac2cb643364a37966445586fe0a8df"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "07620fd339948e86260802252c6e7f9b"
server_key_iv: "6364ddd8186db4ccdfbda4c8d2d71981"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.533236 25450 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:44.547657 25450 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:44.551472 25450 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:44.551683 25450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:44.551973 25450 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:44.552333 25450 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:44.552395 25450 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.552438 25450 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:44.552465 25450 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.559310 25450 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:34059
I20260928 20:14:44.559348 25578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:34059 every 8 connection(s)
I20260928 20:14:44.559679 25450 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:44.566583 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 25450
I20260928 20:14:44.566665 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:14:44.566833 25336 external_mini_cluster.cc:1428] Setting key 2d4825f913bea4ac0c22280f064455b1
I20260928 20:14:44.569886 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.560430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:59423 (local address 127.24.190.62:45517)
0928 20:14:44.560478 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:44.560480 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:44.560734 (+ 254us) server_negotiation.cc:407] Connection header received
0928 20:14:44.561309 (+ 575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:44.561310 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:44.561327 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:44.561400 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:44.562440 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.562948 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.563938 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.564149 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.564235 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.566537 (+ 2302us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:44.566538 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:44.566538 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:44.566545 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:44.568211 (+ 1666us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.568792 (+ 581us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.568793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.568793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.568915 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.569186 (+ 271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.569187 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.569187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.569344 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:44.569415 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:44.569675 (+ 260us) server_negotiation.cc:299] Negotiation successful
0928 20:14:44.569772 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:14:44.569953 25581 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.560415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:45517 (local address 127.24.190.1:59423)
0928 20:14:44.560601 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:44.560642 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:44.561195 (+ 553us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:44.561485 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:44.561489 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:44.562080 (+ 591us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:44.562334 (+ 254us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:44.562342 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.563045 (+ 703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.563046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:44.563836 (+ 790us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:44.563838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.564245 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.564247 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:44.564374 (+ 127us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.564922 (+ 548us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:44.564930 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:44.566425 (+ 1495us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:44.568296 (+ 1871us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:44.568304 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:44.568306 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:44.568710 (+ 404us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:44.569003 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:44.569003 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:44.569004 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:44.569109 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:44.569423 (+ 314us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:44.569428 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:44.569547 (+ 119us) client_negotiation.cc:769] Sending connection context
0928 20:14:44.569630 (+ 83us) client_negotiation.cc:240] Negotiation successful
0928 20:14:44.569752 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":85,"threads_started":1}
I20260928 20:14:44.570710 25579 heartbeater.cc:347] Connected to a master server at 127.24.190.62:45517
I20260928 20:14:44.570794 25579 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:44.570998 25579 heartbeater.cc:511] Master 127.24.190.62:45517 requested a full tablet report, sending...
I20260928 20:14:44.571651 25388 ts_manager.cc:194] Registered new tserver with Master: f0ac2cb643364a37966445586fe0a8df (127.24.190.1:34059)
I20260928 20:14:44.572631 25388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:59423
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:14:44.602515 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45517
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:44.693902 25584 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:44.694187 25584 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:44.694229 25584 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:44.695701 25584 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:44.695808 25584 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:44.695859 25584 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:14:44.697644 25584 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45517
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25584
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:44.697960 25584 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:44.698220 25584 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:44.703677 25589 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.703682 25590 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:44.703889 25584 server_base.cc:1034] running on GCE node
W20260928 20:14:44.703801 25592 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:44.704264 25584 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:44.704514 25584 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:44.705749 25584 hybrid_clock.cc:648] HybridClock initialized: now 1790626484705753 us; error 69 us; skew 500 ppm
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:44.708635 25584 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:14:44.709172 25584 webserver.cc:460] Webserver started at http://127.24.190.2:46739/ using document root <none> and password file <none>
I20260928 20:14:44.709424 25584 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:44.709498 25584 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:44.709674 25584 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:44.711004 25584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "fc7316546ff24b6f86630e6095155536"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "1f3697abd1b73b9858b26522f9b0a225"
server_key_iv: "2a02e98e375baf3f1c2f2f0953a0ce74"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.711401 25584 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "fc7316546ff24b6f86630e6095155536"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "1f3697abd1b73b9858b26522f9b0a225"
server_key_iv: "2a02e98e375baf3f1c2f2f0953a0ce74"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.712937 25584 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:14:44.713783 25599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.714004 25584 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:44.714111 25584 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "fc7316546ff24b6f86630e6095155536"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "1f3697abd1b73b9858b26522f9b0a225"
server_key_iv: "2a02e98e375baf3f1c2f2f0953a0ce74"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.714190 25584 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:44.732931 25584 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:44.735034 25584 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:44.735189 25584 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:44.735471 25584 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:44.735797 25584 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:44.735852 25584 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.735893 25584 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:44.735919 25584 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.742435 25584 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:45083
I20260928 20:14:44.742601 25712 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:45083 every 8 connection(s)
I20260928 20:14:44.742892 25584 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:14:44.748095 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 25584
I20260928 20:14:44.748181 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:14:44.748457 25336 external_mini_cluster.cc:1428] Setting key 351cbd81fb9d11b272984f08d39a880f
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:44.753062 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.743699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:56743 (local address 127.24.190.62:45517)
0928 20:14:44.743780 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:44.743783 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:44.743987 (+ 204us) server_negotiation.cc:407] Connection header received
0928 20:14:44.744625 (+ 638us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:44.744626 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:44.744637 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:44.744690 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:44.745717 (+ 1027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.746222 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.747382 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.747571 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.747628 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.750157 (+ 2529us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:44.750159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:44.750159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:44.750168 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:44.751636 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.752077 (+ 441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.752079 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.752079 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.752138 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.752403 (+ 265us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.752404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.752404 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.752523 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:44.752595 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:44.752880 (+ 285us) server_negotiation.cc:299] Negotiation successful
0928 20:14:44.752963 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:14:44.753270 25715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.743646 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:45517 (local address 127.24.190.2:56743)
0928 20:14:44.743850 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:44.743894 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:44.744520 (+ 626us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:44.744747 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:44.744751 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:44.745394 (+ 643us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:44.745627 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:44.745634 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.746473 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.746474 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:44.747276 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:44.747278 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.747665 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.747666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:44.747776 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.748391 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:44.748402 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:44.750051 (+ 1649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:44.751737 (+ 1686us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:44.751745 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:44.751748 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:44.751985 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:44.752207 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:44.752208 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:44.752208 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:44.752325 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:44.752596 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:44.752603 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:44.752744 (+ 141us) client_negotiation.cc:769] Sending connection context
0928 20:14:44.752853 (+ 109us) client_negotiation.cc:240] Negotiation successful
0928 20:14:44.753025 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":109,"threads_started":1}
I20260928 20:14:44.754005 25713 heartbeater.cc:347] Connected to a master server at 127.24.190.62:45517
I20260928 20:14:44.754088 25713 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:44.754336 25713 heartbeater.cc:511] Master 127.24.190.62:45517 requested a full tablet report, sending...
I20260928 20:14:44.754781 25388 ts_manager.cc:194] Registered new tserver with Master: fc7316546ff24b6f86630e6095155536 (127.24.190.2:45083)
I20260928 20:14:44.755327 25388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:56743
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:14:44.777719 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45517
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:44.861632 25718 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:44.861860 25718 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:44.861886 25718 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:44.863106 25718 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:44.863149 25718 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:44.863175 25718 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:14:44.864547 25718 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45517
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25718
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:44.864735 25718 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:44.864916 25718 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:44.869987 25723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.869980 25724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:44.870117 25726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:44.870261 25718 server_base.cc:1034] running on GCE node
I20260928 20:14:44.870586 25718 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:44.870838 25718 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:44.871974 25718 hybrid_clock.cc:648] HybridClock initialized: now 1790626484871956 us; error 32 us; skew 500 ppm
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:44.874897 25718 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:14:44.875501 25718 webserver.cc:460] Webserver started at http://127.24.190.3:46287/ using document root <none> and password file <none>
I20260928 20:14:44.875761 25718 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:44.875828 25718 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:44.875982 25718 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:44.877031 25718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "db52c67ddd124de78f2b4a809334ca96"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "67ab3d08d45d3fd209ca70ea9bbf528b"
server_key_iv: "1d1c9eca3ba09cc44d14070239da591b"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.877409 25718 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "db52c67ddd124de78f2b4a809334ca96"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "67ab3d08d45d3fd209ca70ea9bbf528b"
server_key_iv: "1d1c9eca3ba09cc44d14070239da591b"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.878760 25718 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:14:44.879491 25733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.879681 25718 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:44.879786 25718 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "db52c67ddd124de78f2b4a809334ca96"
format_stamp: "Formatted at 2026-09-28 20:14:44 on dist-test-slave-n45k"
server_key: "67ab3d08d45d3fd209ca70ea9bbf528b"
server_key_iv: "1d1c9eca3ba09cc44d14070239da591b"
server_key_version: "encryptionkey@0"
I20260928 20:14:44.879861 25718 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:44.893124 25718 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:44.895263 25718 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:44.895449 25718 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:44.895694 25718 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:44.896010 25718 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:44.896064 25718 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.896100 25718 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:44.896126 25718 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:44.902900 25718 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:42395
I20260928 20:14:44.902959 25846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:42395 every 8 connection(s)
I20260928 20:14:44.903295 25718 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:44.912756 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.904046 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:58895 (local address 127.24.190.62:45517)
0928 20:14:44.904138 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:44.904141 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:44.904366 (+ 225us) server_negotiation.cc:407] Connection header received
0928 20:14:44.904886 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:44.904887 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:44.904899 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:44.904959 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:44.905888 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.906486 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.907493 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.907706 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.907802 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.909990 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:44.909992 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:44.909992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:44.910000 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:44.911511 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.911887 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.911888 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.911889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.911943 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.912173 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.912174 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.912174 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.912301 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:44.912357 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:44.912582 (+ 225us) server_negotiation.cc:299] Negotiation successful
0928 20:14:44.912689 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":47}
I20260928 20:14:44.912899 25849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.904020 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:45517 (local address 127.24.190.3:58895)
0928 20:14:44.904198 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:44.904231 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:44.904777 (+ 546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:44.905032 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:44.905036 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:44.905593 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:44.905782 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:44.905787 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.906591 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.906592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:44.907390 (+ 798us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:44.907391 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.907803 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.907804 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:44.907929 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.908408 (+ 479us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:44.908416 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:44.909881 (+ 1465us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:44.911586 (+ 1705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:44.911591 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:44.911593 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:44.911813 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:44.912009 (+ 196us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:44.912009 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:44.912010 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:44.912109 (+ 99us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:44.912358 (+ 249us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:44.912362 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:44.912474 (+ 112us) client_negotiation.cc:769] Sending connection context
0928 20:14:44.912555 (+ 81us) client_negotiation.cc:240] Negotiation successful
0928 20:14:44.912672 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":85,"threads_started":1}
I20260928 20:14:44.913352 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 25718
I20260928 20:14:44.913440 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:14:44.913484 25847 heartbeater.cc:347] Connected to a master server at 127.24.190.62:45517
I20260928 20:14:44.913575 25847 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:44.913589 25336 external_mini_cluster.cc:1428] Setting key 4d811722fe7715f823e05ac0b19578a1
I20260928 20:14:44.913739 25847 heartbeater.cc:511] Master 127.24.190.62:45517 requested a full tablet report, sending...
I20260928 20:14:44.914141 25388 ts_manager.cc:194] Registered new tserver with Master: db52c67ddd124de78f2b4a809334ca96 (127.24.190.3:42395)
I20260928 20:14:44.914655 25388 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:58895
I20260928 20:14:44.914752 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:14:44.937824 25854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.929813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49322 (local address 127.24.190.1:34059)
0928 20:14:44.929992 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:44.930002 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:44.930013 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:14:44.930039 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:44.930042 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:44.930054 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:44.930121 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:44.930826 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.931595 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.932378 (+ 783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.932722 (+ 344us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.932780 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.935100 (+ 2320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:44.935115 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:44.935115 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:44.935122 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:44.936621 (+ 1499us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.937051 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.937055 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.937055 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.937135 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.937341 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.937342 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.937342 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.937479 (+ 137us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:44.937604 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:44.937642 (+ 38us) server_negotiation.cc:299] Negotiation successful
0928 20:14:44.937703 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":104,"threads_started":1}
W20260928 20:14:44.938174 25493 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49322
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 28 20:14:44 dist-test-slave-n45k krb5kdc[25343](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626484, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:14:44.961114 25854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:44.953532 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49324 (local address 127.24.190.1:34059)
0928 20:14:44.953659 (+ 127us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:44.953661 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:44.953777 (+ 116us) server_negotiation.cc:407] Connection header received
0928 20:14:44.954110 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:44.954111 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:44.954125 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:44.954179 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:44.954908 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.955400 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.956160 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:44.956383 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:44.956460 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:44.958778 (+ 2318us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:44.958780 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:44.958780 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:44.958803 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:44.960131 (+ 1328us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.960481 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.960482 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.960482 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.960535 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:44.960698 (+ 163us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:44.960699 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:44.960699 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:44.960817 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:44.960902 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:44.960983 (+ 81us) server_negotiation.cc:299] Negotiation successful
0928 20:14:44.961047 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260928 20:14:44.961694 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 25450
I20260928 20:14:44.966544 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 25584
I20260928 20:14:44.971835 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 25718
I20260928 20:14:44.976267 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 25356
2026-09-28T20:14:44Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (1931 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:45 dist-test-slave-n45k krb5kdc[25861](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:45 dist-test-slave-n45k krb5kdc[25861](info): set up 2 sockets
Sep 28 20:14:45 dist-test-slave-n45k krb5kdc[25861](info): commencing operation
krb5kdc: starting...
W20260928 20:14:46.046237 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.050s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:46Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:46.165813 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39063
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:43619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:39063
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:46.246342 25874 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:46.246567 25874 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:46.246592 25874 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:46.247784 25874 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:14:46.247828 25874 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:46.247843 25874 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:46.247854 25874 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:14:46.247912 25874 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:14:46.249384 25874 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:39063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25874
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:46.249641 25874 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:46.249876 25874 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:46.254733 25879 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:46.254739 25880 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:46.254747 25882 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.255008 25874 server_base.cc:1034] running on GCE node
I20260928 20:14:46.255259 25874 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:46.255551 25874 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:46.256708 25874 hybrid_clock.cc:648] HybridClock initialized: now 1790626486256685 us; error 36 us; skew 500 ppm
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:46.262562 25874 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:14:46.263029 25874 webserver.cc:460] Webserver started at http://127.24.190.62:43435/ using document root <none> and password file <none>
I20260928 20:14:46.263267 25874 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:46.263312 25874 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:46.263444 25874 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:46.264513 25874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "0f0a104182694c259f289d6395e00728"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "0369af96640bd2e0d745dd39f0caed9b"
server_key_iv: "afb717a0b06b34ae8f19c972ba351e7b"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.264896 25874 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "0f0a104182694c259f289d6395e00728"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "0369af96640bd2e0d745dd39f0caed9b"
server_key_iv: "afb717a0b06b34ae8f19c972ba351e7b"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.266331 25874 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:14:46.267145 25889 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.267331 25874 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:14:46.267424 25874 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "0f0a104182694c259f289d6395e00728"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "0369af96640bd2e0d745dd39f0caed9b"
server_key_iv: "afb717a0b06b34ae8f19c972ba351e7b"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.267482 25874 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:46.281194 25874 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:46.283532 25874 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:46.283655 25874 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:46.287606 25874 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:39063
I20260928 20:14:46.287636 25941 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:39063 every 8 connection(s)
I20260928 20:14:46.288019 25874 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:14:46.288950 25942 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:46.290472 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 25874
I20260928 20:14:46.290571 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:14:46.290719 25336 external_mini_cluster.cc:1428] Setting key 294385bc4e21f8cafd6ff713dae0c7b1
I20260928 20:14:46.291641 25942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728: Bootstrap starting.
I20260928 20:14:46.292311 25942 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:46.292615 25942 log.cc:824] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:46.293298 25942 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728: No bootstrap required, opened a new log
I20260928 20:14:46.295123 25942 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0a104182694c259f289d6395e00728" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39063 } }
I20260928 20:14:46.295276 25942 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:46.295312 25942 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0f0a104182694c259f289d6395e00728, State: Initialized, Role: FOLLOWER
I20260928 20:14:46.295744 25942 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0a104182694c259f289d6395e00728" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39063 } }
I20260928 20:14:46.295840 25942 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:14:46.295884 25942 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:14:46.295957 25942 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:46.296536 25942 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0a104182694c259f289d6395e00728" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39063 } }
I20260928 20:14:46.296655 25942 leader_election.cc:302] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0f0a104182694c259f289d6395e00728; no voters:
I20260928 20:14:46.296828 25942 leader_election.cc:288] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:14:46.296896 25947 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:46.297041 25947 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [term 1 LEADER]: Becoming Leader. State: Replica: 0f0a104182694c259f289d6395e00728, State: Running, Role: LEADER
I20260928 20:14:46.297088 25942 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:14:46.297134 25947 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0a104182694c259f289d6395e00728" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39063 } }
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:46.297435 25949 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0f0a104182694c259f289d6395e00728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0a104182694c259f289d6395e00728" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39063 } } }
I20260928 20:14:46.297519 25949 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:46.297421 25947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0f0a104182694c259f289d6395e00728. Latest consensus state: current_term: 1 leader_uuid: "0f0a104182694c259f289d6395e00728" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0f0a104182694c259f289d6395e00728" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39063 } } }
I20260928 20:14:46.297710 25947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:46.297833 25953 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:14:46.299791 25953 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:14:46.301945 25953 catalog_manager.cc:1347] Generated new cluster ID: a97ceef8b0e0408d84afe363ce23b730
I20260928 20:14:46.302000 25953 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:14:46.302139 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.291265 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59320 (local address 127.24.190.62:39063)
0928 20:14:46.291452 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.291462 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.291494 (+ 32us) server_negotiation.cc:407] Connection header received
0928 20:14:46.292047 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.292055 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.292112 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.292263 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.292904 (+ 641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.293883 (+ 979us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.294682 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.295080 (+ 398us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.295218 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.297890 (+ 2672us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.297894 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.297894 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.297906 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.300120 (+ 2214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.300543 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.300547 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.300547 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.300654 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.300926 (+ 272us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.300927 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.300927 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.301410 (+ 483us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.301530 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.301770 (+ 240us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.301910 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":138,"thread_start_us":76,"threads_started":1}
I20260928 20:14:46.310316 25953 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:14:46.310856 25953 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:14:46.313086 25953 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0f0a104182694c259f289d6395e00728: Generated new TSK 0
I20260928 20:14:46.313273 25953 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:14:46.344731 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39063
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:43619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:46.448140 25968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:46.448367 25968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:46.448391 25968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:46.449541 25968 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:46.449584 25968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:46.449610 25968 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:14:46.451185 25968 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39063
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.25968
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:46.451438 25968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:46.451689 25968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:46.457607 25973 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:46.457592 25974 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.457799 25968 server_base.cc:1034] running on GCE node
W20260928 20:14:46.457589 25976 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.458206 25968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:46.458599 25968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:46.459767 25968 hybrid_clock.cc:648] HybridClock initialized: now 1790626486459747 us; error 36 us; skew 500 ppm
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:46.462422 25968 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:14:46.462983 25968 webserver.cc:460] Webserver started at http://127.24.190.1:39009/ using document root <none> and password file <none>
I20260928 20:14:46.463248 25968 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:46.463335 25968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:46.463486 25968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:46.464556 25968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "a2a2967c307a43b4b040ffdd667d41a3"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "fe6d3f3e30ab51362e60e6fbd4bdbe98"
server_key_iv: "43a885d74b8c9711dccea7bf36d2822e"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.464927 25968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "a2a2967c307a43b4b040ffdd667d41a3"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "fe6d3f3e30ab51362e60e6fbd4bdbe98"
server_key_iv: "43a885d74b8c9711dccea7bf36d2822e"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.466964 25968 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260928 20:14:46.467741 25983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.467936 25968 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:14:46.468034 25968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "a2a2967c307a43b4b040ffdd667d41a3"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "fe6d3f3e30ab51362e60e6fbd4bdbe98"
server_key_iv: "43a885d74b8c9711dccea7bf36d2822e"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.468122 25968 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:46.486057 25968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:46.488440 25968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:46.488647 25968 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:46.488942 25968 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:46.489341 25968 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:46.489403 25968 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.489441 25968 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:46.489495 25968 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.496064 25968 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:41497
I20260928 20:14:46.496322 26096 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:41497 every 8 connection(s)
I20260928 20:14:46.496528 25968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:14:46.500717 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 25968
I20260928 20:14:46.500839 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:14:46.500995 25336 external_mini_cluster.cc:1428] Setting key d44715141a817b1c044accd1fe9794b2
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:46.507330 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.497310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:33623 (local address 127.24.190.62:39063)
0928 20:14:46.497356 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.497359 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.497571 (+ 212us) server_negotiation.cc:407] Connection header received
0928 20:14:46.498787 (+ 1216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.498788 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.498799 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.498853 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.499481 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.499983 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.501385 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.501637 (+ 252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.501699 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.504165 (+ 2466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.504167 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.504167 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.504174 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.505805 (+ 1631us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.506254 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.506255 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.506256 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.506337 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.506615 (+ 278us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.506617 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.506617 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.506784 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.506864 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.507146 (+ 282us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.507235 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:14:46.507536 26099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.497309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39063 (local address 127.24.190.1:33623)
0928 20:14:46.497463 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.497501 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.498682 (+ 1181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.498915 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.498919 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.499192 (+ 273us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:46.499401 (+ 209us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.499405 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.500077 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.500078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.501288 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.501291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.501730 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.501731 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.501889 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.502506 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:46.502514 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:46.504057 (+ 1543us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:46.505907 (+ 1850us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:46.505915 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:46.505917 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:46.506165 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:46.506424 (+ 259us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:46.506425 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:46.506425 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:46.506546 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:46.506866 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:46.506875 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:46.507014 (+ 139us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.507124 (+ 110us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.507295 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":89,"threads_started":1}
I20260928 20:14:46.508035 26097 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39063
I20260928 20:14:46.508133 26097 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:46.508317 26097 heartbeater.cc:511] Master 127.24.190.62:39063 requested a full tablet report, sending...
I20260928 20:14:46.508944 25906 ts_manager.cc:194] Registered new tserver with Master: a2a2967c307a43b4b040ffdd667d41a3 (127.24.190.1:41497)
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:14:46.510035 25906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:33623
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:14:46.530225 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39063
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:43619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:46.610692 26102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:46.610903 26102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:46.610927 26102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:46.612094 26102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:46.612138 26102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:46.612164 26102 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:14:46.613718 26102 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39063
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:46.613977 26102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:46.614207 26102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:46.619539 26107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.619585 26102 server_base.cc:1034] running on GCE node
W20260928 20:14:46.619532 26108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:46.619535 26110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.620018 26102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:46.620234 26102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:46.621379 26102 hybrid_clock.cc:648] HybridClock initialized: now 1790626486621359 us; error 36 us; skew 500 ppm
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:46.623963 26102 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:14:46.624495 26102 webserver.cc:460] Webserver started at http://127.24.190.2:40085/ using document root <none> and password file <none>
I20260928 20:14:46.624740 26102 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:46.624807 26102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:46.624962 26102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:46.625978 26102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "1c3ca399633c4405b4aa78e6e23738ac"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "08c8c45f2372f794ed9af277eec56691"
server_key_iv: "8af53e8295e529a463db51114432b010"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.626401 26102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "1c3ca399633c4405b4aa78e6e23738ac"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "08c8c45f2372f794ed9af277eec56691"
server_key_iv: "8af53e8295e529a463db51114432b010"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.627686 26102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:46.628463 26117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.628633 26102 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:46.628737 26102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "1c3ca399633c4405b4aa78e6e23738ac"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "08c8c45f2372f794ed9af277eec56691"
server_key_iv: "8af53e8295e529a463db51114432b010"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.628824 26102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:46.643000 26102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:46.645498 26102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:46.645673 26102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:46.645915 26102 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:46.646232 26102 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:46.646320 26102 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.646380 26102 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:46.646415 26102 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.652405 26102 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:42963
I20260928 20:14:46.652456 26230 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:42963 every 8 connection(s)
I20260928 20:14:46.652808 26102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:14:46.655172 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 26102
I20260928 20:14:46.655292 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:14:46.655470 25336 external_mini_cluster.cc:1428] Setting key 22e2ee750958ddbec7b0d85dc4ef4cbb
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
I20260928 20:14:46.663414 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.653603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:35699 (local address 127.24.190.62:39063)
0928 20:14:46.653693 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.653696 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.653902 (+ 206us) server_negotiation.cc:407] Connection header received
0928 20:14:46.654863 (+ 961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.654864 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.654876 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.654926 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.655755 (+ 829us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.656411 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.657570 (+ 1159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.657768 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.657831 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.660368 (+ 2537us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.660369 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.660370 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.660377 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.661916 (+ 1539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.662419 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.662420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.662421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.662481 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.662738 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.662738 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.662739 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.662858 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.662933 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.663240 (+ 307us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.663322 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:14:46.663604 26233 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.653580 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39063 (local address 127.24.190.2:35699)
0928 20:14:46.653748 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.653788 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.654740 (+ 952us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.655026 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.655030 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.655301 (+ 271us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:46.655571 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.655577 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.656502 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.656503 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.657479 (+ 976us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.657482 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.657856 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.657857 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.658006 (+ 149us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.658600 (+ 594us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:46.658609 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:46.660256 (+ 1647us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:46.662014 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:46.662021 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:46.662023 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:46.662251 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:46.662558 (+ 307us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:46.662559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:46.662559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:46.662666 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:46.662936 (+ 270us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:46.662943 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:46.663080 (+ 137us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.663191 (+ 111us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.663359 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":74,"threads_started":1}
I20260928 20:14:46.664146 26231 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39063
I20260928 20:14:46.664233 26231 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:46.664438 26231 heartbeater.cc:511] Master 127.24.190.62:39063 requested a full tablet report, sending...
I20260928 20:14:46.664784 25906 ts_manager.cc:194] Registered new tserver with Master: 1c3ca399633c4405b4aa78e6e23738ac (127.24.190.2:42963)
I20260928 20:14:46.665215 25906 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:35699
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:14:46.682261 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39063
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:43619
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:46.764192 26236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:46.764417 26236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:46.764443 26236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:46.765586 26236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:46.765623 26236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:46.765650 26236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:14:46.767135 26236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43619
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39063
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26236
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:46.767336 26236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:46.767516 26236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:46.772580 26242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:46.772604 26244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.772634 26236 server_base.cc:1034] running on GCE node
W20260928 20:14:46.772583 26241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:46.773018 26236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:46.773298 26236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:46.774451 26236 hybrid_clock.cc:648] HybridClock initialized: now 1790626486774438 us; error 29 us; skew 500 ppm
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:46.777014 26236 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:14:46.777503 26236 webserver.cc:460] Webserver started at http://127.24.190.3:34443/ using document root <none> and password file <none>
I20260928 20:14:46.777736 26236 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:46.777802 26236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:46.777943 26236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:46.779035 26236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "bd474d9bf8374a728a12adc901b4ec56"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "f426d0c904aa52f3284a523597e4f34d"
server_key_iv: "08320c4bbd992bfc8f2a2004eccf2d36"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.779382 26236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "bd474d9bf8374a728a12adc901b4ec56"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "f426d0c904aa52f3284a523597e4f34d"
server_key_iv: "08320c4bbd992bfc8f2a2004eccf2d36"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.780658 26236 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:14:46.781358 26251 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.781519 26236 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:14:46.781611 26236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "bd474d9bf8374a728a12adc901b4ec56"
format_stamp: "Formatted at 2026-09-28 20:14:46 on dist-test-slave-n45k"
server_key: "f426d0c904aa52f3284a523597e4f34d"
server_key_iv: "08320c4bbd992bfc8f2a2004eccf2d36"
server_key_version: "encryptionkey@0"
I20260928 20:14:46.781689 26236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:46.788519 26236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:46.790323 26236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:46.790484 26236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:46.790741 26236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:46.791076 26236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:46.791132 26236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.791167 26236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:46.791213 26236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:46.797390 26236 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:33981
I20260928 20:14:46.797473 26364 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:33981 every 8 connection(s)
I20260928 20:14:46.798214 26236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:46.807307 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.799056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:58573 (local address 127.24.190.62:39063)
0928 20:14:46.799125 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.799128 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.799392 (+ 264us) server_negotiation.cc:407] Connection header received
0928 20:14:46.800359 (+ 967us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.800361 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.800371 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.800425 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.801022 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.801505 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.802620 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.802803 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.802858 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.804916 (+ 2058us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.804917 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.804917 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.804924 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.806105 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.806518 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.806518 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.806519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.806568 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.806772 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.806773 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.806773 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.806871 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.806920 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.807121 (+ 201us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.807177 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:14:46.807408 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 26236
I20260928 20:14:46.807453 26367 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.799044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39063 (local address 127.24.190.3:58573)
0928 20:14:46.799236 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.799279 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.800268 (+ 989us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.800483 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.800486 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.800741 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:46.800942 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.800946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.801602 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.801603 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.802546 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.802549 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.802876 (+ 327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.802876 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.802979 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.803465 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:46.803473 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:46.804829 (+ 1356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:46.806178 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:46.806184 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:46.806185 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:46.806467 (+ 282us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:46.806634 (+ 167us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:46.806634 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:46.806635 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:46.806732 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:46.806923 (+ 191us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:46.806926 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:46.807032 (+ 106us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.807109 (+ 77us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.807222 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":86,"threads_started":1}
I20260928 20:14:46.807485 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:14:46.807622 25336 external_mini_cluster.cc:1428] Setting key de0cfae32e8078d90260781fbdced967
I20260928 20:14:46.808084 26365 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39063
I20260928 20:14:46.808189 26365 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:46.808418 26365 heartbeater.cc:511] Master 127.24.190.62:39063 requested a full tablet report, sending...
I20260928 20:14:46.808779 25905 ts_manager.cc:194] Registered new tserver with Master: bd474d9bf8374a728a12adc901b4ec56 (127.24.190.3:33981)
I20260928 20:14:46.809147 25905 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:58573
I20260928 20:14:46.819481 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:14:46.826743 25945 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.821065 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.24.190.62:39063)
0928 20:14:46.821113 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.821115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.821273 (+ 158us) server_negotiation.cc:407] Connection header received
0928 20:14:46.821294 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.821295 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.821303 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.821356 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.821893 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.822441 (+ 548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.823114 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.823372 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.823427 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.824513 (+ 1086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.824514 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.824514 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.824521 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.825700 (+ 1179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.826017 (+ 317us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.826018 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.826018 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.826066 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.826223 (+ 157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.826223 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.826223 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.826441 (+ 218us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.826518 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.826614 (+ 96us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.826679 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:14:46.828853 25905 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59336:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:14:46.830447 25905 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:46.836656 26377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.832592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:33981 (local address 127.0.0.1:40546)
0928 20:14:46.832766 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.832774 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.832851 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.833194 (+ 343us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.833198 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.833200 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:46.833269 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.833270 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.834621 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.834622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.835487 (+ 865us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.835490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.836346 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.836347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.836427 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.836440 (+ 13us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.836516 (+ 76us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.836567 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"mutex_wait_us":1,"thread_start_us":105,"threads_started":1}
I20260928 20:14:46.836663 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.832867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40546 (local address 127.24.190.3:33981)
0928 20:14:46.833014 (+ 147us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.833018 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.833025 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:14:46.833077 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.833079 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.833094 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.833174 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:46.833351 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.834514 (+ 1163us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.835577 (+ 1063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.836244 (+ 667us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.836317 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.836380 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.836540 (+ 160us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.836576 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":79,"threads_started":1}
I20260928 20:14:46.836931 26379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.832739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:41497 (local address 127.0.0.1:52866)
0928 20:14:46.832833 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.832844 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.832898 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.833483 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.833484 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.833485 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:46.833517 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.833519 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.834467 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.834468 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.835883 (+ 1415us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.835885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.836709 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.836710 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.836774 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.836779 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.836837 (+ 58us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.836875 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":74,"mutex_wait_us":99,"thread_start_us":56,"threads_started":1}
I20260928 20:14:46.837229 26381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.833138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52866 (local address 127.24.190.1:41497)
0928 20:14:46.833338 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.833342 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.833350 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:46.833393 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.833395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.833411 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.833478 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:46.833574 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.834361 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.835947 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.836566 (+ 619us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.836626 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.836675 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.837113 (+ 438us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.837151 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":93,"threads_started":1}
I20260928 20:14:46.837291 26376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.832561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:42963 (local address 127.0.0.1:38952)
0928 20:14:46.832718 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.832759 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.832829 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.833299 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.833300 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.833302 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:46.833356 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.833358 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.834739 (+ 1381us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.834739 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.835826 (+ 1087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.835828 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.837103 (+ 1275us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.837106 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.837162 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.837165 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.837195 (+ 30us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.837223 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":45,"threads_started":1}
I20260928 20:14:46.837447 26299 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee1793b24742cc99e5f4d2bc6b706f (DEFAULT_TABLE table=test-table [id=a3558e65574442bda756c4f8435d29ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:46.837697 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.832650 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38952 (local address 127.24.190.2:42963)
0928 20:14:46.833119 (+ 469us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.833122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.833130 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:46.833186 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.833188 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.833203 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.833278 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:46.833437 (+ 159us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.834645 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.835906 (+ 1261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.836627 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.837460 (+ 833us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.837521 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.837545 (+ 24us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.837584 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":440,"thread_start_us":70,"threads_started":1}
I20260928 20:14:46.837806 26299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee1793b24742cc99e5f4d2bc6b706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:46.837807 26031 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee1793b24742cc99e5f4d2bc6b706f (DEFAULT_TABLE table=test-table [id=a3558e65574442bda756c4f8435d29ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:46.838110 26031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee1793b24742cc99e5f4d2bc6b706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:46.838459 26165 tablet_service.cc:1467] Processing CreateTablet for tablet 5fee1793b24742cc99e5f4d2bc6b706f (DEFAULT_TABLE table=test-table [id=a3558e65574442bda756c4f8435d29ee]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:46.838737 26165 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5fee1793b24742cc99e5f4d2bc6b706f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:46.840994 26382 tablet_bootstrap.cc:492] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: Bootstrap starting.
I20260928 20:14:46.841336 26384 tablet_bootstrap.cc:492] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3: Bootstrap starting.
I20260928 20:14:46.841360 26383 tablet_bootstrap.cc:492] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56: Bootstrap starting.
I20260928 20:14:46.841681 26382 tablet_bootstrap.cc:654] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:46.841962 26383 tablet_bootstrap.cc:654] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:46.841962 26384 tablet_bootstrap.cc:654] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:46.842214 26382 log.cc:824] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:46.842561 26384 log.cc:824] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:46.842578 26383 log.cc:824] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:46.843039 26382 tablet_bootstrap.cc:492] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: No bootstrap required, opened a new log
I20260928 20:14:46.843109 26382 ts_tablet_manager.cc:1397] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:14:46.843319 26384 tablet_bootstrap.cc:492] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3: No bootstrap required, opened a new log
I20260928 20:14:46.843392 26384 ts_tablet_manager.cc:1397] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:14:46.843567 26383 tablet_bootstrap.cc:492] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56: No bootstrap required, opened a new log
I20260928 20:14:46.843631 26383 ts_tablet_manager.cc:1397] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:46.844724 26382 raft_consensus.cc:348] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.844889 26382 raft_consensus.cc:374] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:46.844934 26382 raft_consensus.cc:729] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c3ca399633c4405b4aa78e6e23738ac, State: Initialized, Role: FOLLOWER
I20260928 20:14:46.845037 26382 consensus_queue.cc:260] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.845316 26382 ts_tablet_manager.cc:1428] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:14:46.845448 26231 heartbeater.cc:503] Master 127.24.190.62:39063 was elected leader, sending a full tablet report...
I20260928 20:14:46.845856 26383 raft_consensus.cc:348] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.845856 26384 raft_consensus.cc:348] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.846024 26383 raft_consensus.cc:374] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:46.846024 26384 raft_consensus.cc:374] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:46.846060 26383 raft_consensus.cc:729] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bd474d9bf8374a728a12adc901b4ec56, State: Initialized, Role: FOLLOWER
I20260928 20:14:46.846060 26384 raft_consensus.cc:729] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a2967c307a43b4b040ffdd667d41a3, State: Initialized, Role: FOLLOWER
I20260928 20:14:46.846189 26384 consensus_queue.cc:260] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.846189 26383 consensus_queue.cc:260] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.846479 26384 ts_tablet_manager.cc:1428] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:14:46.846479 26383 ts_tablet_manager.cc:1428] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:14:46.846593 26097 heartbeater.cc:503] Master 127.24.190.62:39063 was elected leader, sending a full tablet report...
I20260928 20:14:46.846895 26365 heartbeater.cc:503] Master 127.24.190.62:39063 was elected leader, sending a full tablet report...
I20260928 20:14:46.903059 26390 raft_consensus.cc:482] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:46.903224 26390 raft_consensus.cc:504] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
W20260928 20:14:46.903651 26232 tablet.cc:2369] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:14:46.903662 26390 leader_election.cc:288] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1c3ca399633c4405b4aa78e6e23738ac (127.24.190.2:42963), bd474d9bf8374a728a12adc901b4ec56 (127.24.190.3:33981)
I20260928 20:14:46.906796 26391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.903858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:33981 (local address 127.24.190.1:53977)
0928 20:14:46.904154 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.904162 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.904239 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.904385 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.904385 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.904387 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:46.904464 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.904466 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.905077 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.905078 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.905883 (+ 805us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.905885 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.906527 (+ 642us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.906528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.906605 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.906608 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.906670 (+ 62us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.906711 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":273,"mutex_wait_us":2,"thread_start_us":146,"threads_started":1}
I20260928 20:14:46.906792 26380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.904074 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:53977 (local address 127.24.190.3:33981)
0928 20:14:46.904151 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.904153 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.904229 (+ 76us) server_negotiation.cc:407] Connection header received
0928 20:14:46.904295 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.904296 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.904308 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.904382 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:46.904536 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.904994 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.905977 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.906436 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.906528 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.906536 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.906691 (+ 155us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.906726 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260928 20:14:46.906924 26378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.903959 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:36297 (local address 127.24.190.2:42963)
0928 20:14:46.904028 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.904030 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.904041 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:14:46.904072 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.904073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.904112 (+ 39us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.904191 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:46.904384 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.904949 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.906039 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.906523 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.906623 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.906632 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.906823 (+ 191us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.906862 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:14:46.906914 26099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.903841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:42963 (local address 127.24.190.1:36297)
0928 20:14:46.903912 (+ 71us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:46.903926 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:46.903973 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:46.904206 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:46.904207 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:46.904210 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:46.904295 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.904297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.905046 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.905047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.905898 (+ 851us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:46.905900 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.906619 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.906620 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:46.906715 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.906718 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:46.906790 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:14:46.906838 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":2}
I20260928 20:14:46.907290 26185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee1793b24742cc99e5f4d2bc6b706f" candidate_uuid: "a2a2967c307a43b4b040ffdd667d41a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c3ca399633c4405b4aa78e6e23738ac" is_pre_election: true
I20260928 20:14:46.907299 26319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee1793b24742cc99e5f4d2bc6b706f" candidate_uuid: "a2a2967c307a43b4b040ffdd667d41a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd474d9bf8374a728a12adc901b4ec56" is_pre_election: true
I20260928 20:14:46.907444 26185 raft_consensus.cc:2454] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a2967c307a43b4b040ffdd667d41a3 in term 0.
I20260928 20:14:46.907454 26319 raft_consensus.cc:2454] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a2967c307a43b4b040ffdd667d41a3 in term 0.
I20260928 20:14:46.907716 25984 leader_election.cc:302] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1c3ca399633c4405b4aa78e6e23738ac, a2a2967c307a43b4b040ffdd667d41a3; no voters:
I20260928 20:14:46.907869 26390 raft_consensus.cc:2781] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:46.907930 26390 raft_consensus.cc:482] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:46.907961 26390 raft_consensus.cc:3037] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:46.908660 26390 raft_consensus.cc:504] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.908942 26390 leader_election.cc:288] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [CANDIDATE]: Term 1 election: Requested vote from peers 1c3ca399633c4405b4aa78e6e23738ac (127.24.190.2:42963), bd474d9bf8374a728a12adc901b4ec56 (127.24.190.3:33981)
I20260928 20:14:46.908957 26185 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee1793b24742cc99e5f4d2bc6b706f" candidate_uuid: "a2a2967c307a43b4b040ffdd667d41a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1c3ca399633c4405b4aa78e6e23738ac"
I20260928 20:14:46.909022 26319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5fee1793b24742cc99e5f4d2bc6b706f" candidate_uuid: "a2a2967c307a43b4b040ffdd667d41a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bd474d9bf8374a728a12adc901b4ec56"
I20260928 20:14:46.909034 26185 raft_consensus.cc:3037] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:46.909096 26319 raft_consensus.cc:3037] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:46.909981 26319 raft_consensus.cc:2454] T 5fee1793b24742cc99e5f4d2bc6b706f P bd474d9bf8374a728a12adc901b4ec56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a2967c307a43b4b040ffdd667d41a3 in term 1.
I20260928 20:14:46.909981 26185 raft_consensus.cc:2454] T 5fee1793b24742cc99e5f4d2bc6b706f P 1c3ca399633c4405b4aa78e6e23738ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a2967c307a43b4b040ffdd667d41a3 in term 1.
I20260928 20:14:46.910240 25985 leader_election.cc:302] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a2967c307a43b4b040ffdd667d41a3, bd474d9bf8374a728a12adc901b4ec56; no voters:
I20260928 20:14:46.910346 26390 raft_consensus.cc:2781] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:46.910518 26390 raft_consensus.cc:686] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [term 1 LEADER]: Becoming Leader. State: Replica: a2a2967c307a43b4b040ffdd667d41a3, State: Running, Role: LEADER
I20260928 20:14:46.910635 26390 consensus_queue.cc:237] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } }
I20260928 20:14:46.911567 25904 catalog_manager.cc:5495] T 5fee1793b24742cc99e5f4d2bc6b706f P a2a2967c307a43b4b040ffdd667d41a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a2967c307a43b4b040ffdd667d41a3 (127.24.190.1). New cstate: current_term: 1 leader_uuid: "a2a2967c307a43b4b040ffdd667d41a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1c3ca399633c4405b4aa78e6e23738ac" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 42963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a2967c307a43b4b040ffdd667d41a3" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 41497 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bd474d9bf8374a728a12adc901b4ec56" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 33981 } health_report { overall_health: UNKNOWN } } }
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:14:46.936179 26381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.928530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52868 (local address 127.24.190.1:41497)
0928 20:14:46.928633 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.928635 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.928658 (+ 23us) server_negotiation.cc:407] Connection header received
0928 20:14:46.928726 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.928727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.928738 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.928779 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.929377 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.929863 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.930683 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.930881 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.930934 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.933508 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.933517 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.933517 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.933524 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.935085 (+ 1561us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.935450 (+ 365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.935453 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.935453 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.935513 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.935675 (+ 162us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.935676 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.935676 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.935834 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.935966 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.935996 (+ 30us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.936059 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:14:46.959048 26381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.951687 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52870 (local address 127.24.190.1:41497)
0928 20:14:46.951760 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.951763 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.951857 (+ 94us) server_negotiation.cc:407] Connection header received
0928 20:14:46.951944 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.951944 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.951961 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.952025 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.952629 (+ 604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.953118 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.953861 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.954061 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.954154 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.956525 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.956527 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.956527 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.956534 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.957805 (+ 1271us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.958134 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.958134 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.958135 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.958181 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.958539 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.958540 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.958540 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.958633 (+ 93us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.958708 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.958885 (+ 177us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.958948 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 28 20:14:46 dist-test-slave-n45k krb5kdc[25861](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626486, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:14:46.982753 26381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:46.975693 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52874 (local address 127.24.190.1:41497)
0928 20:14:46.975777 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:46.975779 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:46.975814 (+ 35us) server_negotiation.cc:407] Connection header received
0928 20:14:46.975900 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:46.975901 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:46.975911 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:46.975961 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:46.976471 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.976939 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.977630 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:46.977837 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:46.977886 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:46.980422 (+ 2536us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:46.980423 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:46.980423 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:46.980436 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:46.981730 (+ 1294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.982030 (+ 300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.982031 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.982031 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.982081 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:46.982234 (+ 153us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:46.982235 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:46.982235 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:46.982414 (+ 179us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:46.982492 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:46.982591 (+ 99us) server_negotiation.cc:299] Negotiation successful
0928 20:14:46.982646 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260928 20:14:46.983248 26011 tablet_service.cc:2908] Rejecting scan request for tablet 5fee1793b24742cc99e5f4d2bc6b706f: Uninitialized: clean time has not yet been initialized
I20260928 20:14:46.984206 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 25968
I20260928 20:14:46.989441 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 26102
I20260928 20:14:46.993954 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 26236
I20260928 20:14:46.998657 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 25874
2026-09-28T20:14:47Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (2023 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:47 dist-test-slave-n45k krb5kdc[26406](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:47 dist-test-slave-n45k krb5kdc[26406](info): set up 2 sockets
Sep 28 20:14:47 dist-test-slave-n45k krb5kdc[26406](info): commencing operation
krb5kdc: starting...
W20260928 20:14:48.038769 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.019s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:48.165832 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46159
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:46159
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:48.247196 26419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:48.247431 26419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:48.247455 26419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:48.248641 26419 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:14:48.248684 26419 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260928 20:14:48.248697 26419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:48.248710 26419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:48.248723 26419 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:14:48.248735 26419 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:14:48.250309 26419 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:46159
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46159
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:48.250603 26419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:48.250855 26419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:48.256103 26424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.256103 26427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.256243 26425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:48.256695 26419 server_base.cc:1034] running on GCE node
I20260928 20:14:48.256963 26419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:48.257347 26419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:48.258523 26419 hybrid_clock.cc:648] HybridClock initialized: now 1790626488258510 us; error 30 us; skew 500 ppm
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:48.261370 26419 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:14:48.261839 26419 webserver.cc:460] Webserver started at http://127.24.190.62:44785/ using document root <none> and password file <none>
I20260928 20:14:48.262087 26419 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:48.262159 26419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:48.262342 26419 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:48.263455 26419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "6e388890ae49cdf1b47393515442be09"
server_key_iv: "fa53f30cbee15490002e1c968f5f7286"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.263821 26419 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "6e388890ae49cdf1b47393515442be09"
server_key_iv: "fa53f30cbee15490002e1c968f5f7286"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.265250 26419 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:14:48.266072 26434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.266247 26419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:48.266396 26419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "6e388890ae49cdf1b47393515442be09"
server_key_iv: "fa53f30cbee15490002e1c968f5f7286"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.266487 26419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:48.273923 26419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:48.276369 26419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:48.276567 26419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:48.282187 26419 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:46159
I20260928 20:14:48.282338 26496 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:46159 every 8 connection(s)
I20260928 20:14:48.282656 26419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:14:48.283304 26497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:48.285616 26497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: Bootstrap starting.
I20260928 20:14:48.286221 26497 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:48.286580 26497 log.cc:824] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:48.287300 26497 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: No bootstrap required, opened a new log
I20260928 20:14:48.289361 26497 raft_consensus.cc:348] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46159 } }
I20260928 20:14:48.289505 26497 raft_consensus.cc:374] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:48.289527 26497 raft_consensus.cc:729] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8bb1b49d2c34cefa6fa6e80e9ae2333, State: Initialized, Role: FOLLOWER
I20260928 20:14:48.289701 26497 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46159 } }
I20260928 20:14:48.289765 26497 raft_consensus.cc:388] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:14:48.289788 26497 raft_consensus.cc:482] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:14:48.289837 26497 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:48.290429 26497 raft_consensus.cc:504] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46159 } }
I20260928 20:14:48.290536 26497 leader_election.cc:302] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b8bb1b49d2c34cefa6fa6e80e9ae2333; no voters:
I20260928 20:14:48.290710 26497 leader_election.cc:288] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:14:48.290822 26500 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:48.290835 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 26419
I20260928 20:14:48.290930 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:14:48.290993 26497 sys_catalog.cc:564] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:14:48.291082 26500 raft_consensus.cc:686] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [term 1 LEADER]: Becoming Leader. State: Replica: b8bb1b49d2c34cefa6fa6e80e9ae2333, State: Running, Role: LEADER
I20260928 20:14:48.291105 25336 external_mini_cluster.cc:1428] Setting key 4412a2ba8463e7db9e59b97b7e689423
I20260928 20:14:48.291312 26500 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46159 } }
I20260928 20:14:48.291661 26501 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46159 } } }
I20260928 20:14:48.291750 26501 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:48.291728 26502 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8bb1b49d2c34cefa6fa6e80e9ae2333. Latest consensus state: current_term: 1 leader_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b8bb1b49d2c34cefa6fa6e80e9ae2333" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46159 } } }
I20260928 20:14:48.291967 26502 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:48.292063 26511 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:14:48.292641 26511 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:14:48.294560 26511 catalog_manager.cc:1347] Generated new cluster ID: 4a31639a2c2e468e91a97ae28d917948
I20260928 20:14:48.294612 26511 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:48.303318 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.291553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43038 (local address 127.24.190.62:46159)
0928 20:14:48.292116 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.292128 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.292167 (+ 39us) server_negotiation.cc:407] Connection header received
0928 20:14:48.292301 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.292308 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.292366 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.292545 (+ 179us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.293288 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.294810 (+ 1522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.295854 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.296485 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.296596 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.299620 (+ 3024us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.299625 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.299625 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.299637 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.301625 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.302043 (+ 418us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.302045 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.302046 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.302160 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.302393 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.302393 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.302394 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.302687 (+ 293us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.302844 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.302964 (+ 120us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.303091 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":62,"threads_started":1}
I20260928 20:14:48.331295 26511 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:14:48.332080 26511 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:14:48.337899 26511 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: Generated new TSK 0
I20260928 20:14:48.338104 26511 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:14:48.365998 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46159
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:48.447844 26523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:48.448057 26523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:48.448082 26523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:48.449261 26523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:48.449306 26523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:48.449326 26523 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:14:48.449343 26523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:14:48.450964 26523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:46159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26523
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:48.451212 26523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:48.451471 26523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:48.456796 26531 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.456826 26529 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.456795 26528 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:48.457052 26523 server_base.cc:1034] running on GCE node
I20260928 20:14:48.457269 26523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:48.457480 26523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:48.458627 26523 hybrid_clock.cc:648] HybridClock initialized: now 1790626488458613 us; error 27 us; skew 500 ppm
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:48.461068 26523 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:14:48.461541 26523 webserver.cc:460] Webserver started at http://127.24.190.1:37821/ using document root <none> and password file <none>
I20260928 20:14:48.461764 26523 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:48.461807 26523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:48.461982 26523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:48.463109 26523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "742785ed01d9414d83e166b2eaa4824e"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "3dfe59477bba1c3f167a1a6e92d0b00c"
server_key_iv: "ab97166d932a85e099ba42ee69dcf7f1"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.463457 26523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "742785ed01d9414d83e166b2eaa4824e"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "3dfe59477bba1c3f167a1a6e92d0b00c"
server_key_iv: "ab97166d932a85e099ba42ee69dcf7f1"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.464869 26523 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:14:48.465610 26538 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.465818 26523 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:14:48.465922 26523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "742785ed01d9414d83e166b2eaa4824e"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "3dfe59477bba1c3f167a1a6e92d0b00c"
server_key_iv: "ab97166d932a85e099ba42ee69dcf7f1"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.465978 26523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:48.475346 26523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:48.477875 26523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:48.478011 26523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:48.478664 26523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:48.478714 26523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.478740 26523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:48.478801 26523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.486083 26523 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:45623
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:48.486330 26653 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:45623 every 8 connection(s)
I20260928 20:14:48.486518 26523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:14:48.489439 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.479093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:52331 (local address 127.24.190.62:46159)
0928 20:14:48.479136 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.479138 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.479378 (+ 240us) server_negotiation.cc:407] Connection header received
0928 20:14:48.479874 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.479876 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.479888 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.479936 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.480821 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.481823 (+ 1002us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.483435 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.483757 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.483842 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.486849 (+ 3007us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.486851 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.486851 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.486872 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.488136 (+ 1264us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.488547 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.488548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.488548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.488598 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.488895 (+ 297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.488895 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.488896 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.488995 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.489044 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.489300 (+ 256us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.489376 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:14:48.489779 26547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.479083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.24.190.1:52331)
0928 20:14:48.479237 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.479271 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.479762 (+ 491us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.480039 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.480044 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.480423 (+ 379us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:48.480693 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.480700 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.481933 (+ 1233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.481934 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.483337 (+ 1403us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.483340 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.483886 (+ 546us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.483888 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.484074 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.484742 (+ 668us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:48.484754 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:48.486734 (+ 1980us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:48.488216 (+ 1482us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.488223 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.488231 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.488475 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.488666 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.488666 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.488667 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.488834 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.489054 (+ 220us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:48.489059 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:48.489179 (+ 120us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.489273 (+ 94us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.489442 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260928 20:14:48.490361 26654 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46159
I20260928 20:14:48.490455 26654 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:48.490688 26654 heartbeater.cc:511] Master 127.24.190.62:46159 requested a full tablet report, sending...
I20260928 20:14:48.491304 26450 ts_manager.cc:194] Registered new tserver with Master: 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623)
I20260928 20:14:48.491582 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 26523
I20260928 20:14:48.491704 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:14:48.491876 25336 external_mini_cluster.cc:1428] Setting key 17d4736d519036153c503044b8fa9a26
I20260928 20:14:48.492192 26450 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:52331
I20260928 20:14:48.498394 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.492407 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:34759 (local address 127.24.190.62:46159)
0928 20:14:48.492455 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.492457 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.492464 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:14:48.492484 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.492485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.492494 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.492543 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.492968 (+ 425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.493507 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.494497 (+ 990us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.494700 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.494756 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.495772 (+ 1016us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.495774 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.495774 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.495781 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.497250 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.497598 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.497599 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.497599 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.497658 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.497852 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.497853 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.497853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.497966 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.498043 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.498198 (+ 155us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.498295 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":29}
I20260928 20:14:48.498404 26660 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.491360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.24.190.1:34759)
0928 20:14:48.491577 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.491588 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.491640 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.492564 (+ 924us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.492565 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.492770 (+ 205us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:48.492879 (+ 109us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.492882 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.493598 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.493599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.494400 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.494403 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.494772 (+ 369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.494774 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.494857 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.495411 (+ 554us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:48.495415 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:48.495680 (+ 265us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:48.497336 (+ 1656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.497337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.497338 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.497514 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.497729 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.497730 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.497730 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.497791 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.498035 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:48.498036 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:48.498080 (+ 44us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.498163 (+ 83us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.498269 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":145,"threads_started":1}
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:14:48.521059 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46159
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:48.601992 26663 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:48.602262 26663 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:48.602432 26663 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:48.603653 26663 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:48.603724 26663 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:48.603760 26663 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:14:48.603799 26663 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:14:48.605247 26663 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:46159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26663
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:48.605511 26663 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:48.605741 26663 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:48.610929 26669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.610904 26668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.610929 26671 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:48.610961 26663 server_base.cc:1034] running on GCE node
I20260928 20:14:48.611394 26663 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:48.611644 26663 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:48.612782 26663 hybrid_clock.cc:648] HybridClock initialized: now 1790626488612756 us; error 38 us; skew 500 ppm
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:48.615548 26663 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:14:48.616103 26663 webserver.cc:460] Webserver started at http://127.24.190.2:36009/ using document root <none> and password file <none>
I20260928 20:14:48.616348 26663 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:48.616396 26663 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:48.616585 26663 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:48.617818 26663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "10ef1d3cbbd34038a7c9348eb7c6190c"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "0203aefbd846460e9d337ed3aebb195d"
server_key_iv: "93a2ac97beb897e2c0c174617d9d904a"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.618232 26663 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "10ef1d3cbbd34038a7c9348eb7c6190c"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "0203aefbd846460e9d337ed3aebb195d"
server_key_iv: "93a2ac97beb897e2c0c174617d9d904a"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.619823 26663 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:48.620617 26678 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.620792 26663 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:48.620913 26663 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "10ef1d3cbbd34038a7c9348eb7c6190c"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "0203aefbd846460e9d337ed3aebb195d"
server_key_iv: "93a2ac97beb897e2c0c174617d9d904a"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.620990 26663 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:48.631244 26663 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:48.633112 26663 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:48.633280 26663 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:48.633852 26663 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:48.633919 26663 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.633960 26663 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:48.633984 26663 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:48.641983 26663 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:41379
I20260928 20:14:48.642436 26663 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:14:48.642416 26793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:41379 every 8 connection(s)
I20260928 20:14:48.643441 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.634238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:57727 (local address 127.24.190.62:46159)
0928 20:14:48.634326 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.634328 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.634648 (+ 320us) server_negotiation.cc:407] Connection header received
0928 20:14:48.635126 (+ 478us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.635128 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.635144 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.635233 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.635950 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.636478 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.637572 (+ 1094us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.637774 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.637867 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.640304 (+ 2437us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.640305 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.640306 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.640314 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.641902 (+ 1588us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.642408 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.642409 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.642409 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.642490 (+ 81us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.642805 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.642806 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.642806 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.642961 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.643034 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.643289 (+ 255us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.643359 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260928 20:14:48.643514 26687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.634239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.24.190.2:57727)
0928 20:14:48.634505 (+ 266us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.634543 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.635024 (+ 481us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.635285 (+ 261us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.635288 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.635547 (+ 259us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:48.635834 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.635840 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.636577 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.636578 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.637466 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.637469 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.637871 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.637872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.638011 (+ 139us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.638608 (+ 597us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:48.638620 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:48.640199 (+ 1579us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:48.641997 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.642003 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.642005 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.642312 (+ 307us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.642569 (+ 257us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.642570 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.642571 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.642717 (+ 146us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.643032 (+ 315us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:48.643036 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:48.643153 (+ 117us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.643235 (+ 82us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.643360 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"thread_start_us":188,"threads_started":1}
I20260928 20:14:48.644007 26794 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46159
I20260928 20:14:48.644129 26794 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:48.644266 26794 heartbeater.cc:511] Master 127.24.190.62:46159 requested a full tablet report, sending...
I20260928 20:14:48.644632 26451 ts_manager.cc:194] Registered new tserver with Master: 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2:41379)
I20260928 20:14:48.645180 26451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:57727
I20260928 20:14:48.645957 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 26663
I20260928 20:14:48.646064 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:14:48.646239 25336 external_mini_cluster.cc:1428] Setting key 282984d1f26c6c24b71954f984913377
I20260928 20:14:48.651888 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.645281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:32875 (local address 127.24.190.62:46159)
0928 20:14:48.645338 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.645339 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.645348 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:14:48.645376 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.645377 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.645386 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.645451 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.646151 (+ 700us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.646793 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.647574 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.647784 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.647874 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.648839 (+ 965us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.648840 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.648840 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.648847 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.650635 (+ 1788us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.651009 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.651011 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.651011 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.651081 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.651304 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.651305 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.651305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.651469 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.651558 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.651727 (+ 169us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.651813 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 20:14:48.652217 26800 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.645053 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.24.190.2:32875)
0928 20:14:48.645176 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.645187 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.645237 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.645462 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.645463 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.646013 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:48.646061 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.646063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.646976 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.646977 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.647486 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.647487 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.647872 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.647873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.647954 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.648428 (+ 474us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:48.648438 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:48.648728 (+ 290us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:48.650752 (+ 2024us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.650753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.650753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.650929 (+ 176us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.651163 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.651164 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.651164 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.651232 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.651544 (+ 312us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:48.651545 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:48.651595 (+ 50us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.651995 (+ 400us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.652121 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":75,"threads_started":1}
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:14:48.673260 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46159
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35465
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:48.754892 26803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:48.755093 26803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:48.755116 26803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:48.756233 26803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:48.756268 26803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:48.756289 26803 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:14:48.756306 26803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:14:48.757694 26803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35465
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:46159
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.26803
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:48.757892 26803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:48.758070 26803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:48.763284 26809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:48.763334 26811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:48.763509 26803 server_base.cc:1034] running on GCE node
W20260928 20:14:48.763284 26808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:48.763842 26803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:48.764113 26803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:48.765261 26803 hybrid_clock.cc:648] HybridClock initialized: now 1790626488765249 us; error 27 us; skew 500 ppm
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:48.767786 26803 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:14:48.768276 26803 webserver.cc:460] Webserver started at http://127.24.190.3:44951/ using document root <none> and password file <none>
I20260928 20:14:48.768532 26803 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:48.768580 26803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:48.768740 26803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:48.769959 26803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "59d515529b4f444e81e5a1412cb4f84a"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "a8885724bd4c68fbcfb5f527da92103a"
server_key_iv: "b3ad6dda5f49d9b01287cb28ae1c01ae"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.770355 26803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "59d515529b4f444e81e5a1412cb4f84a"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "a8885724bd4c68fbcfb5f527da92103a"
server_key_iv: "b3ad6dda5f49d9b01287cb28ae1c01ae"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.771670 26803 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:48.772415 26818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.772586 26803 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:48.772684 26803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "59d515529b4f444e81e5a1412cb4f84a"
format_stamp: "Formatted at 2026-09-28 20:14:48 on dist-test-slave-n45k"
server_key: "a8885724bd4c68fbcfb5f527da92103a"
server_key_iv: "b3ad6dda5f49d9b01287cb28ae1c01ae"
server_key_version: "encryptionkey@0"
I20260928 20:14:48.772768 26803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:48.784839 26803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:48.786761 26803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:48.786936 26803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:48.787539 26803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:48.787588 26803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:48.787629 26803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:48.787655 26803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:48.794531 26803 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:38537
I20260928 20:14:48.794612 26933 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:38537 every 8 connection(s)
I20260928 20:14:48.794896 26803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:14:48.797857 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.787917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:56943 (local address 127.24.190.62:46159)
0928 20:14:48.787987 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.787989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.788249 (+ 260us) server_negotiation.cc:407] Connection header received
0928 20:14:48.788754 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.788755 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.788769 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.788810 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.789665 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.790450 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.792067 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.792382 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.792474 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.795032 (+ 2558us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.795033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.795034 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.795041 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.796494 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.796917 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.796918 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.796918 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.796975 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.797224 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.797224 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.797225 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.797345 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.797426 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.797690 (+ 264us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.797769 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 20:14:48.798056 26827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.787900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.24.190.3:56943)
0928 20:14:48.788143 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.788171 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.788645 (+ 474us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.788902 (+ 257us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.788906 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.789272 (+ 366us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:48.789553 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.789579 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.790555 (+ 976us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.790556 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.791923 (+ 1367us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.791926 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.792506 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.792507 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.792670 (+ 163us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.793220 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:48.793230 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:48.794934 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:48.796599 (+ 1665us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.796606 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.796608 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.796826 (+ 218us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.797046 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.797047 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.797048 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.797156 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.797416 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:48.797422 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:48.797559 (+ 137us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.797668 (+ 109us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.797818 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":213,"thread_start_us":87,"threads_started":1}
I20260928 20:14:48.798091 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 26803
I20260928 20:14:48.798172 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:14:48.798408 25336 external_mini_cluster.cc:1428] Setting key 82a27d0e976642d1e59fdf0df0b83a10
I20260928 20:14:48.798739 26934 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46159
I20260928 20:14:48.798837 26934 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:48.799041 26934 heartbeater.cc:511] Master 127.24.190.62:46159 requested a full tablet report, sending...
I20260928 20:14:48.799350 26451 ts_manager.cc:194] Registered new tserver with Master: 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537)
I20260928 20:14:48.799826 26451 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:56943
I20260928 20:14:48.804653 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.799789 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:56145 (local address 127.24.190.62:46159)
0928 20:14:48.799826 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.799828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.799985 (+ 157us) server_negotiation.cc:407] Connection header received
0928 20:14:48.800042 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.800043 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.800053 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.800102 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.800418 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.800942 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.801592 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.801763 (+ 171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.801810 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.802667 (+ 857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.802667 (+ 0us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.802668 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.802672 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.803853 (+ 1181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.804138 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.804139 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.804139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.804185 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.804322 (+ 137us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.804323 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.804323 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.804404 (+ 81us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.804448 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.804548 (+ 100us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.804598 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 20:14:48.804670 26940 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.799749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.24.190.3:56145)
0928 20:14:48.799927 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.799938 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.799995 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.800116 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.800117 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.800295 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:48.800341 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.800343 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.801022 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.801023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.801525 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.801526 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.801822 (+ 296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.801823 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.801879 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.802321 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:48.802325 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:48.802603 (+ 278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:48.803927 (+ 1324us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.803927 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.803928 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.804078 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.804239 (+ 161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:48.804240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:48.804240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:48.804286 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:48.804452 (+ 166us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:48.804453 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:48.804485 (+ 32us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.804535 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.804603 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"thread_start_us":134,"threads_started":1}
I20260928 20:14:48.810022 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 28 20:14:48 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:48.832044 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.825027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43052 (local address 127.24.190.62:46159)
0928 20:14:48.825080 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.825082 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.825092 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:14:48.825138 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.825139 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.825147 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.825201 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:48.826017 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.826644 (+ 627us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.827362 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.827538 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.827587 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.829653 (+ 2066us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:48.829655 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:48.829655 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:48.829661 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:48.831130 (+ 1469us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.831431 (+ 301us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.831431 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.831432 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.831480 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:48.831640 (+ 160us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:48.831641 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:48.831641 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:48.831739 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:48.831813 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.831917 (+ 104us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.831977 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 20:14:48.833760 26451 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:14:48.835439 26451 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:48.841688 26949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.837579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38537 (local address 127.0.0.1:57568)
0928 20:14:48.837922 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.837932 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.837991 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.838394 (+ 403us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.838395 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.838397 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:48.838443 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.838444 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.839315 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.839317 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.840611 (+ 1294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.840614 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.841349 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.841350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.841430 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.841443 (+ 13us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.841536 (+ 93us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.841592 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":331,"mutex_wait_us":3,"thread_start_us":64,"threads_started":1}
I20260928 20:14:48.841841 26952 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.837766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:45623 (local address 127.0.0.1:43396)
0928 20:14:48.838093 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.838104 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.838158 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.838438 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.838440 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.838442 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:48.838489 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.838491 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.839715 (+ 1224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.839716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.840603 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.840606 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.841546 (+ 940us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.841547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.841604 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.841607 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.841656 (+ 49us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.841687 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":315,"mutex_wait_us":1,"thread_start_us":45,"threads_started":1}
I20260928 20:14:48.841864 26951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.837676 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57568 (local address 127.24.190.3:38537)
0928 20:14:48.837884 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.837888 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.838074 (+ 186us) server_negotiation.cc:407] Connection header received
0928 20:14:48.838116 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.838118 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.838132 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.838207 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:48.838523 (+ 316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.839213 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.840705 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.841245 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.841345 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.841416 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.841730 (+ 314us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.841772 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":97,"threads_started":1}
I20260928 20:14:48.842029 26950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.837690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59100 (local address 127.24.190.2:41379)
0928 20:14:48.837874 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.837879 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.837970 (+ 91us) server_negotiation.cc:407] Connection header received
0928 20:14:48.838116 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.838120 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.838136 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.838212 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:48.838419 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.839587 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.840810 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.841513 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.841578 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.841622 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.841895 (+ 273us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.841935 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":84,"threads_started":1}
I20260928 20:14:48.842226 26948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.837579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:41379 (local address 127.0.0.1:59100)
0928 20:14:48.837871 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:48.837912 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:48.837990 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:48.838215 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:48.838218 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:48.838220 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:48.838310 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.838312 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.839688 (+ 1376us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.839688 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.840736 (+ 1048us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:48.840738 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.841658 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.841659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:48.841731 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.841735 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:14:48.841789 (+ 54us) client_negotiation.cc:240] Negotiation successful
0928 20:14:48.841840 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":267,"thread_start_us":56,"threads_started":1}
I20260928 20:14:48.842449 26953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:48.837918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43396 (local address 127.24.190.1:45623)
0928 20:14:48.838077 (+ 159us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:48.838082 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:48.838147 (+ 65us) server_negotiation.cc:407] Connection header received
0928 20:14:48.838252 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:48.838288 (+ 36us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:48.838304 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:48.838371 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:48.838564 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.839632 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.840693 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:48.841454 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:48.841528 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:48.841584 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:48.841669 (+ 85us) server_negotiation.cc:299] Negotiation successful
0928 20:14:48.841711 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":85,"threads_started":1}
I20260928 20:14:48.842536 26868 tablet_service.cc:1467] Processing CreateTablet for tablet e045fb1bc34243269aa111686d02fd89 (DEFAULT_TABLE table=test-table [id=aa7ace38bb7044979051382906649b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:48.842923 26868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e045fb1bc34243269aa111686d02fd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:48.842901 26728 tablet_service.cc:1467] Processing CreateTablet for tablet e045fb1bc34243269aa111686d02fd89 (DEFAULT_TABLE table=test-table [id=aa7ace38bb7044979051382906649b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:48.843236 26728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e045fb1bc34243269aa111686d02fd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:48.843195 26588 tablet_service.cc:1467] Processing CreateTablet for tablet e045fb1bc34243269aa111686d02fd89 (DEFAULT_TABLE table=test-table [id=aa7ace38bb7044979051382906649b42]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:48.843505 26588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e045fb1bc34243269aa111686d02fd89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:48.846242 26954 tablet_bootstrap.cc:492] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Bootstrap starting.
I20260928 20:14:48.846721 26955 tablet_bootstrap.cc:492] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Bootstrap starting.
I20260928 20:14:48.847084 26956 tablet_bootstrap.cc:492] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Bootstrap starting.
I20260928 20:14:48.847339 26955 tablet_bootstrap.cc:654] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:48.847339 26954 tablet_bootstrap.cc:654] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:48.847645 26956 tablet_bootstrap.cc:654] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:48.847689 26955 log.cc:824] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:48.847689 26954 log.cc:824] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:48.847997 26956 log.cc:824] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:48.848469 26954 tablet_bootstrap.cc:492] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: No bootstrap required, opened a new log
I20260928 20:14:48.848558 26954 ts_tablet_manager.cc:1397] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260928 20:14:48.848644 26956 tablet_bootstrap.cc:492] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: No bootstrap required, opened a new log
I20260928 20:14:48.848693 26956 ts_tablet_manager.cc:1397] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:48.850109 26954 raft_consensus.cc:348] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:48.850124 26956 raft_consensus.cc:348] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:48.850265 26954 raft_consensus.cc:374] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:48.850262 26956 raft_consensus.cc:374] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:48.850322 26954 raft_consensus.cc:729] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d515529b4f444e81e5a1412cb4f84a, State: Initialized, Role: FOLLOWER
I20260928 20:14:48.850382 26956 raft_consensus.cc:729] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742785ed01d9414d83e166b2eaa4824e, State: Initialized, Role: FOLLOWER
I20260928 20:14:48.850443 26954 consensus_queue.cc:260] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:48.850508 26956 consensus_queue.cc:260] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:48.850708 26954 ts_tablet_manager.cc:1428] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:14:48.850776 26956 ts_tablet_manager.cc:1428] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260928 20:14:48.850814 26934 heartbeater.cc:503] Master 127.24.190.62:46159 was elected leader, sending a full tablet report...
I20260928 20:14:48.850816 26654 heartbeater.cc:503] Master 127.24.190.62:46159 was elected leader, sending a full tablet report...
I20260928 20:14:48.851385 26955 tablet_bootstrap.cc:492] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: No bootstrap required, opened a new log
I20260928 20:14:48.851454 26955 ts_tablet_manager.cc:1397] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.000s
I20260928 20:14:48.853189 26955 raft_consensus.cc:348] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:48.853369 26955 raft_consensus.cc:374] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:48.853415 26955 raft_consensus.cc:729] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ef1d3cbbd34038a7c9348eb7c6190c, State: Initialized, Role: FOLLOWER
I20260928 20:14:48.853526 26955 consensus_queue.cc:260] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:48.853775 26955 ts_tablet_manager.cc:1428] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:14:48.853833 26794 heartbeater.cc:503] Master 127.24.190.62:46159 was elected leader, sending a full tablet report...
W20260928 20:14:48.893045 26795 tablet.cc:2369] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:14:48.987437 26655 tablet.cc:2369] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:14:49.045809 26935 tablet.cc:2369] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:14:49.230587 26961 raft_consensus.cc:482] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:49.230712 26961 raft_consensus.cc:504] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:49.231035 26961 leader_election.cc:288] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537), 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2:41379)
I20260928 20:14:49.234311 26951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.231468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:39637 (local address 127.24.190.3:38537)
0928 20:14:49.231526 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.231528 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.231571 (+ 43us) server_negotiation.cc:407] Connection header received
0928 20:14:49.231676 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.231677 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.231686 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.231738 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:49.231898 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.232365 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.233411 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.233923 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.234025 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.234035 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.234189 (+ 154us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.234223 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:14:49.234326 26964 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.231365 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38537 (local address 127.24.190.1:39637)
0928 20:14:49.231492 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.231505 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.231590 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.231742 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.231743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.231745 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:49.231822 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.231824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.232451 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.232452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.233300 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.233302 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.234028 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.234028 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.234104 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.234108 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.234171 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.234214 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102,"mutex_wait_us":34,"thread_start_us":70,"threads_started":1}
I20260928 20:14:49.234367 26950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.231496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:54177 (local address 127.24.190.2:41379)
0928 20:14:49.231543 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.231545 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.231574 (+ 29us) server_negotiation.cc:407] Connection header received
0928 20:14:49.231664 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.231665 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.231674 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.231748 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:49.231913 (+ 165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.232370 (+ 457us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.233604 (+ 1234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.233973 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.234069 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.234078 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.234231 (+ 153us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.234299 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:14:49.234409 26963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.231384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:41379 (local address 127.24.190.1:54177)
0928 20:14:49.231511 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.231522 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.231589 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.231751 (+ 162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.231752 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.231754 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:49.231836 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.231838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.232449 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.232450 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.233305 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.233308 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.234071 (+ 763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.234072 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.234141 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.234149 (+ 8us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.234222 (+ 73us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.234263 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":112,"mutex_wait_us":43,"thread_start_us":52,"threads_started":1}
I20260928 20:14:49.234761 26748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e045fb1bc34243269aa111686d02fd89" candidate_uuid: "742785ed01d9414d83e166b2eaa4824e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" is_pre_election: true
I20260928 20:14:49.234761 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e045fb1bc34243269aa111686d02fd89" candidate_uuid: "742785ed01d9414d83e166b2eaa4824e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d515529b4f444e81e5a1412cb4f84a" is_pre_election: true
I20260928 20:14:49.234926 26888 raft_consensus.cc:2454] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742785ed01d9414d83e166b2eaa4824e in term 0.
I20260928 20:14:49.234926 26748 raft_consensus.cc:2454] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 742785ed01d9414d83e166b2eaa4824e in term 0.
I20260928 20:14:49.235139 26541 leader_election.cc:302] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d515529b4f444e81e5a1412cb4f84a, 742785ed01d9414d83e166b2eaa4824e; no voters:
I20260928 20:14:49.235280 26961 raft_consensus.cc:2781] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:49.235337 26961 raft_consensus.cc:482] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:49.235359 26961 raft_consensus.cc:3037] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.236032 26961 raft_consensus.cc:504] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:49.236176 26961 leader_election.cc:288] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [CANDIDATE]: Term 1 election: Requested vote from peers 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537), 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2:41379)
I20260928 20:14:49.236330 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e045fb1bc34243269aa111686d02fd89" candidate_uuid: "742785ed01d9414d83e166b2eaa4824e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d515529b4f444e81e5a1412cb4f84a"
I20260928 20:14:49.236356 26748 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e045fb1bc34243269aa111686d02fd89" candidate_uuid: "742785ed01d9414d83e166b2eaa4824e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c"
I20260928 20:14:49.236420 26748 raft_consensus.cc:3037] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.236420 26888 raft_consensus.cc:3037] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.237257 26748 raft_consensus.cc:2454] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742785ed01d9414d83e166b2eaa4824e in term 1.
I20260928 20:14:49.237257 26888 raft_consensus.cc:2454] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 742785ed01d9414d83e166b2eaa4824e in term 1.
I20260928 20:14:49.237468 26541 leader_election.cc:302] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59d515529b4f444e81e5a1412cb4f84a, 742785ed01d9414d83e166b2eaa4824e; no voters:
I20260928 20:14:49.237565 26961 raft_consensus.cc:2781] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:49.237677 26961 raft_consensus.cc:686] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 1 LEADER]: Becoming Leader. State: Replica: 742785ed01d9414d83e166b2eaa4824e, State: Running, Role: LEADER
I20260928 20:14:49.237807 26961 consensus_queue.cc:237] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } }
I20260928 20:14:49.238597 26451 catalog_manager.cc:5495] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e reported cstate change: term changed from 0 to 1, leader changed from <none> to 742785ed01d9414d83e166b2eaa4824e (127.24.190.1). New cstate: current_term: 1 leader_uuid: "742785ed01d9414d83e166b2eaa4824e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } health_report { overall_health: UNKNOWN } } }
I20260928 20:14:49.282027 26953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.279377 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43398 (local address 127.24.190.1:45623)
0928 20:14:49.279424 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.279426 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.279436 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:14:49.279536 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.279537 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.279554 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.279628 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:49.279781 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.280267 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.281111 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.281306 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.281438 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.281672 (+ 234us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:49.281773 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:49.281864 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.281915 (+ 51us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.281937 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:14:49.284324 26748 raft_consensus.cc:1261] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Refusing update from remote peer 742785ed01d9414d83e166b2eaa4824e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:49.284337 26888 raft_consensus.cc:1261] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Refusing update from remote peer 742785ed01d9414d83e166b2eaa4824e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:49.284685 26965 consensus_queue.cc:1035] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:49.284853 26961 consensus_queue.cc:1035] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [LEADER]: Connected to new peer: Peer: permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:49.290346 26450 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:49.290460 26450 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:49.291249 26450 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: Sending DeleteTablet for 3 replicas of tablet e045fb1bc34243269aa111686d02fd89
I20260928 20:14:49.291559 26868 tablet_service.cc:1514] Processing DeleteTablet for tablet e045fb1bc34243269aa111686d02fd89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:57568
I20260928 20:14:49.291626 26588 tablet_service.cc:1514] Processing DeleteTablet for tablet e045fb1bc34243269aa111686d02fd89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:43396
I20260928 20:14:49.291772 26728 tablet_service.cc:1514] Processing DeleteTablet for tablet e045fb1bc34243269aa111686d02fd89 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:59100
I20260928 20:14:49.291844 26979 tablet_replica.cc:330] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: stopping tablet replica
I20260928 20:14:49.291936 26979 raft_consensus.cc:2229] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:14:49.291960 26980 tablet_replica.cc:330] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: stopping tablet replica
I20260928 20:14:49.292030 26979 raft_consensus.cc:2258] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:49.292086 26980 raft_consensus.cc:2229] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:49.292367 26978 tablet_replica.cc:330] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: stopping tablet replica
I20260928 20:14:49.292409 26450 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43052:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:14:49.292518 26979 ts_tablet_manager.cc:1905] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:14:49.292554 26450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:49.292696 26978 raft_consensus.cc:2229] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:49.292852 26978 raft_consensus.cc:2258] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:49.292955 26980 raft_consensus.cc:2258] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:49.293354 26980 ts_tablet_manager.cc:1905] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:49.294291 26979 ts_tablet_manager.cc:1918] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:14:49.294334 26588 tablet_service.cc:1467] Processing CreateTablet for tablet 53ff4ab9689c4510ad9b594c5d066617 (DEFAULT_TABLE table=test-table [id=8ad5cf6727e941fd9eb89ee3b83e18b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:49.294373 26979 log.cc:1196] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/e045fb1bc34243269aa111686d02fd89
I20260928 20:14:49.294442 26588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ff4ab9689c4510ad9b594c5d066617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:49.294653 26979 ts_tablet_manager.cc:1939] T e045fb1bc34243269aa111686d02fd89 P 742785ed01d9414d83e166b2eaa4824e: Deleting consensus metadata
I20260928 20:14:49.295038 26980 ts_tablet_manager.cc:1918] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:14:49.295104 26980 log.cc:1196] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/e045fb1bc34243269aa111686d02fd89
I20260928 20:14:49.295343 26980 ts_tablet_manager.cc:1939] T e045fb1bc34243269aa111686d02fd89 P 10ef1d3cbbd34038a7c9348eb7c6190c: Deleting consensus metadata
I20260928 20:14:49.295758 26956 tablet_bootstrap.cc:492] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Bootstrap starting.
I20260928 20:14:49.295805 26728 tablet_service.cc:1467] Processing CreateTablet for tablet 53ff4ab9689c4510ad9b594c5d066617 (DEFAULT_TABLE table=test-table [id=8ad5cf6727e941fd9eb89ee3b83e18b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:49.295902 26728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ff4ab9689c4510ad9b594c5d066617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:49.296151 26956 tablet_bootstrap.cc:654] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:49.296505 26438 catalog_manager.cc:4841] TS 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2:41379): tablet e045fb1bc34243269aa111686d02fd89 (table test-table [id=aa7ace38bb7044979051382906649b42]) successfully deleted
I20260928 20:14:49.296756 26956 tablet_bootstrap.cc:492] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: No bootstrap required, opened a new log
I20260928 20:14:49.296793 26956 ts_tablet_manager.cc:1397] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260928 20:14:49.296913 26955 tablet_bootstrap.cc:492] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Bootstrap starting.
I20260928 20:14:49.296931 26956 raft_consensus.cc:348] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.296991 26956 raft_consensus.cc:374] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:49.297015 26956 raft_consensus.cc:729] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742785ed01d9414d83e166b2eaa4824e, State: Initialized, Role: FOLLOWER
I20260928 20:14:49.297058 26956 consensus_queue.cc:260] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.297139 26956 ts_tablet_manager.cc:1428] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260928 20:14:49.297276 26955 tablet_bootstrap.cc:654] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:49.297600 26437 catalog_manager.cc:4841] TS 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623): tablet e045fb1bc34243269aa111686d02fd89 (table test-table [id=aa7ace38bb7044979051382906649b42]) successfully deleted
I20260928 20:14:49.296988 26868 tablet_service.cc:1467] Processing CreateTablet for tablet 53ff4ab9689c4510ad9b594c5d066617 (DEFAULT_TABLE table=test-table [id=8ad5cf6727e941fd9eb89ee3b83e18b7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:49.298043 26868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53ff4ab9689c4510ad9b594c5d066617. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:49.298569 26978 ts_tablet_manager.cc:1905] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:49.299961 26978 ts_tablet_manager.cc:1918] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:14:49.300020 26978 log.cc:1196] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/e045fb1bc34243269aa111686d02fd89
I20260928 20:14:49.300264 26978 ts_tablet_manager.cc:1939] T e045fb1bc34243269aa111686d02fd89 P 59d515529b4f444e81e5a1412cb4f84a: Deleting consensus metadata
I20260928 20:14:49.300477 26954 tablet_bootstrap.cc:492] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Bootstrap starting.
I20260928 20:14:49.300902 26954 tablet_bootstrap.cc:654] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:49.301460 26954 tablet_bootstrap.cc:492] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: No bootstrap required, opened a new log
I20260928 20:14:49.301509 26954 ts_tablet_manager.cc:1397] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260928 20:14:49.301674 26954 raft_consensus.cc:348] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.301744 26954 raft_consensus.cc:374] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:49.301759 26954 raft_consensus.cc:729] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d515529b4f444e81e5a1412cb4f84a, State: Initialized, Role: FOLLOWER
I20260928 20:14:49.301813 26954 consensus_queue.cc:260] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.301908 26954 ts_tablet_manager.cc:1428] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:49.302361 26437 catalog_manager.cc:4841] TS 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537): tablet e045fb1bc34243269aa111686d02fd89 (table test-table [id=aa7ace38bb7044979051382906649b42]) successfully deleted
I20260928 20:14:49.302426 26955 tablet_bootstrap.cc:492] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: No bootstrap required, opened a new log
I20260928 20:14:49.302476 26955 ts_tablet_manager.cc:1397] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.000s
I20260928 20:14:49.302624 26955 raft_consensus.cc:348] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.302711 26955 raft_consensus.cc:374] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:49.302739 26955 raft_consensus.cc:729] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ef1d3cbbd34038a7c9348eb7c6190c, State: Initialized, Role: FOLLOWER
I20260928 20:14:49.302783 26955 consensus_queue.cc:260] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.302889 26955 ts_tablet_manager.cc:1428] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:49.700739 26962 raft_consensus.cc:482] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:49.700847 26962 raft_consensus.cc:504] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.701215 26962 leader_election.cc:288] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623), 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537)
I20260928 20:14:49.704576 26951 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.701777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:51901 (local address 127.24.190.3:38537)
0928 20:14:49.701822 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.701824 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.701923 (+ 99us) server_negotiation.cc:407] Connection header received
0928 20:14:49.702067 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.702069 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.702080 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.702143 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:49.702348 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.702817 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.703858 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.704225 (+ 367us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.704304 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.704314 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.704464 (+ 150us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.704506 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:14:49.704631 26953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.701521 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:46633 (local address 127.24.190.1:45623)
0928 20:14:49.701595 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.701597 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.701755 (+ 158us) server_negotiation.cc:407] Connection header received
0928 20:14:49.701891 (+ 136us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.701893 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.701907 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.701966 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:49.702261 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.702801 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.703866 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.704230 (+ 364us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.704319 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.704327 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.704514 (+ 187us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.704556 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 20:14:49.704587 26985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.701681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38537 (local address 127.24.190.2:51901)
0928 20:14:49.701814 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.701825 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.701891 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.702157 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.702157 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.702159 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:49.702252 (+ 93us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.702254 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.702952 (+ 698us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.702953 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.703757 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.703759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.704310 (+ 551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.704311 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.704390 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.704393 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.704436 (+ 43us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.704465 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"mutex_wait_us":46,"thread_start_us":83,"threads_started":1}
I20260928 20:14:49.704607 26984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.701461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:45623 (local address 127.24.190.2:46633)
0928 20:14:49.701633 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.701645 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.701750 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.702086 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.702087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.702090 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:49.702170 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.702173 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.702913 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.702915 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.703757 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.703760 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.704337 (+ 577us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.704338 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.704412 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.704415 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.704491 (+ 76us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.704526 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":3,"thread_start_us":110,"threads_started":1}
I20260928 20:14:49.705156 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ff4ab9689c4510ad9b594c5d066617" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d515529b4f444e81e5a1412cb4f84a" is_pre_election: true
I20260928 20:14:49.705170 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ff4ab9689c4510ad9b594c5d066617" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742785ed01d9414d83e166b2eaa4824e" is_pre_election: true
I20260928 20:14:49.705265 26888 raft_consensus.cc:2454] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 0.
I20260928 20:14:49.705283 26608 raft_consensus.cc:2454] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 0.
I20260928 20:14:49.705453 26681 leader_election.cc:302] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ef1d3cbbd34038a7c9348eb7c6190c, 59d515529b4f444e81e5a1412cb4f84a; no voters:
I20260928 20:14:49.705582 26962 raft_consensus.cc:2781] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:49.705623 26962 raft_consensus.cc:482] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:49.705651 26962 raft_consensus.cc:3037] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.706347 26962 raft_consensus.cc:504] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.706485 26962 leader_election.cc:288] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 election: Requested vote from peers 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623), 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537)
I20260928 20:14:49.706655 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ff4ab9689c4510ad9b594c5d066617" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742785ed01d9414d83e166b2eaa4824e"
I20260928 20:14:49.706670 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53ff4ab9689c4510ad9b594c5d066617" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d515529b4f444e81e5a1412cb4f84a"
I20260928 20:14:49.706730 26888 raft_consensus.cc:3037] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.706730 26608 raft_consensus.cc:3037] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.707459 26888 raft_consensus.cc:2454] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 1.
I20260928 20:14:49.707557 26608 raft_consensus.cc:2454] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 1.
I20260928 20:14:49.707656 26681 leader_election.cc:302] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ef1d3cbbd34038a7c9348eb7c6190c, 59d515529b4f444e81e5a1412cb4f84a; no voters:
I20260928 20:14:49.707860 26962 raft_consensus.cc:2781] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:49.708060 26962 raft_consensus.cc:686] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 LEADER]: Becoming Leader. State: Replica: 10ef1d3cbbd34038a7c9348eb7c6190c, State: Running, Role: LEADER
I20260928 20:14:49.708159 26962 consensus_queue.cc:237] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.709038 26450 catalog_manager.cc:5495] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2). New cstate: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } health_report { overall_health: UNKNOWN } } }
Sep 28 20:14:49 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:49.778471 26993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.771005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46159 (local address 127.0.0.1:43066)
0928 20:14:49.771463 (+ 458us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.771491 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.771562 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.771745 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.771746 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.772093 (+ 347us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:49.772139 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.772143 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.772825 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.772826 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.773353 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.773355 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.773740 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.773741 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.773789 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.774366 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:49.774371 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:49.775785 (+ 1414us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:49.777325 (+ 1540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:49.777333 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:49.777335 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:49.777555 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:49.777752 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:49.777753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:49.777753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:49.777823 (+ 70us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:49.778039 (+ 216us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:49.778045 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:49.778093 (+ 48us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.778150 (+ 57us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.778390 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":225,"threads_started":1}
I20260928 20:14:49.778622 26994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.771184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43066 (local address 127.24.190.62:46159)
0928 20:14:49.771530 (+ 346us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.771532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.771545 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:14:49.771638 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.771639 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.771651 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.771743 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:49.772239 (+ 496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.772743 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.773452 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.773640 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.773741 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.775885 (+ 2144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:49.775887 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:49.775887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:49.775894 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:49.777205 (+ 1311us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:49.777630 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:49.777631 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:49.777631 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:49.777683 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:49.777882 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:49.777882 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:49.777882 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:49.777983 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:49.778032 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.778179 (+ 147us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.778464 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":191,"server-negotiator.queue_time_us":322,"thread_start_us":70,"threads_started":1}
I20260928 20:14:49.780627 26450 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:43066:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260928 20:14:49.780824 26450 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:49.782251 26868 tablet_service.cc:1467] Processing CreateTablet for tablet 2334e5242bfa4931af6237a9c47c643f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=634e6e1a5e4b4fefb6fc13454f23feb3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:14:49.782315 26588 tablet_service.cc:1467] Processing CreateTablet for tablet 2334e5242bfa4931af6237a9c47c643f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=634e6e1a5e4b4fefb6fc13454f23feb3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:14:49.782413 26728 tablet_service.cc:1467] Processing CreateTablet for tablet 2334e5242bfa4931af6237a9c47c643f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=634e6e1a5e4b4fefb6fc13454f23feb3]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:14:49.782464 26868 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2334e5242bfa4931af6237a9c47c643f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:49.782464 26588 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2334e5242bfa4931af6237a9c47c643f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:49.782541 26728 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2334e5242bfa4931af6237a9c47c643f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:49.783639 26956 tablet_bootstrap.cc:492] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: Bootstrap starting.
I20260928 20:14:49.783982 26956 tablet_bootstrap.cc:654] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:49.783977 26954 tablet_bootstrap.cc:492] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: Bootstrap starting.
I20260928 20:14:49.784363 26954 tablet_bootstrap.cc:654] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:49.784585 26956 tablet_bootstrap.cc:492] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: No bootstrap required, opened a new log
I20260928 20:14:49.784629 26956 ts_tablet_manager.cc:1397] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260928 20:14:49.784690 26955 tablet_bootstrap.cc:492] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: Bootstrap starting.
I20260928 20:14:49.784758 26956 raft_consensus.cc:348] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.784832 26956 raft_consensus.cc:374] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:49.784847 26956 raft_consensus.cc:729] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742785ed01d9414d83e166b2eaa4824e, State: Initialized, Role: FOLLOWER
I20260928 20:14:49.784902 26956 consensus_queue.cc:260] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.784997 26956 ts_tablet_manager.cc:1428] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:49.785025 26974 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.785090 26974 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.785108 26955 tablet_bootstrap.cc:654] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:49.785755 26955 tablet_bootstrap.cc:492] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: No bootstrap required, opened a new log
I20260928 20:14:49.785796 26955 ts_tablet_manager.cc:1397] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:49.785773 26954 tablet_bootstrap.cc:492] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: No bootstrap required, opened a new log
I20260928 20:14:49.785835 26954 ts_tablet_manager.cc:1397] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260928 20:14:49.785938 26955 raft_consensus.cc:348] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.786005 26955 raft_consensus.cc:374] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:49.786020 26955 raft_consensus.cc:729] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10ef1d3cbbd34038a7c9348eb7c6190c, State: Initialized, Role: FOLLOWER
I20260928 20:14:49.785975 26954 raft_consensus.cc:348] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.786065 26954 raft_consensus.cc:374] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:49.786072 26955 consensus_queue.cc:260] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.786094 26954 raft_consensus.cc:729] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d515529b4f444e81e5a1412cb4f84a, State: Initialized, Role: FOLLOWER
I20260928 20:14:49.786145 26954 consensus_queue.cc:260] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.786167 26955 ts_tablet_manager.cc:1428] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:49.786227 26954 ts_tablet_manager.cc:1428] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:49.786199 26962 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.786260 26962 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.786482 26960 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.786579 26960 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.833675 26962 raft_consensus.cc:482] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:49.833766 26962 raft_consensus.cc:504] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.833915 26962 leader_election.cc:288] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623), 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537)
I20260928 20:14:49.834187 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2334e5242bfa4931af6237a9c47c643f" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d515529b4f444e81e5a1412cb4f84a" is_pre_election: true
I20260928 20:14:49.834183 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2334e5242bfa4931af6237a9c47c643f" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742785ed01d9414d83e166b2eaa4824e" is_pre_election: true
I20260928 20:14:49.834311 26888 raft_consensus.cc:2454] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 0.
I20260928 20:14:49.834311 26608 raft_consensus.cc:2454] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 0.
I20260928 20:14:49.834519 26681 leader_election.cc:302] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ef1d3cbbd34038a7c9348eb7c6190c, 59d515529b4f444e81e5a1412cb4f84a; no voters:
I20260928 20:14:49.834659 26962 raft_consensus.cc:2781] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:49.834703 26962 raft_consensus.cc:482] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:49.834725 26962 raft_consensus.cc:3037] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.835444 26962 raft_consensus.cc:504] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.835585 26962 leader_election.cc:288] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 election: Requested vote from peers 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623), 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537)
I20260928 20:14:49.835763 26608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2334e5242bfa4931af6237a9c47c643f" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "742785ed01d9414d83e166b2eaa4824e"
I20260928 20:14:49.835774 26888 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2334e5242bfa4931af6237a9c47c643f" candidate_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59d515529b4f444e81e5a1412cb4f84a"
I20260928 20:14:49.835860 26888 raft_consensus.cc:3037] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.835868 26608 raft_consensus.cc:3037] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:49.836469 26888 raft_consensus.cc:2454] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 1.
I20260928 20:14:49.836664 26681 leader_election.cc:302] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10ef1d3cbbd34038a7c9348eb7c6190c, 59d515529b4f444e81e5a1412cb4f84a; no voters:
I20260928 20:14:49.836771 26608 raft_consensus.cc:2454] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10ef1d3cbbd34038a7c9348eb7c6190c in term 1.
I20260928 20:14:49.836783 26962 raft_consensus.cc:2781] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:49.836833 26962 raft_consensus.cc:686] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 LEADER]: Becoming Leader. State: Replica: 10ef1d3cbbd34038a7c9348eb7c6190c, State: Running, Role: LEADER
I20260928 20:14:49.836889 26962 consensus_queue.cc:237] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } }
I20260928 20:14:49.837154 26986 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: TxnStatusTablet state changed. Reason: New leader 10ef1d3cbbd34038a7c9348eb7c6190c. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.837280 26986 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:14:49.837419 26999 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260928 20:14:49.837548 26999 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260928 20:14:49.837693 26451 catalog_manager.cc:5495] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c reported cstate change: term changed from 0 to 1, leader changed from <none> to 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2). New cstate: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } health_report { overall_health: UNKNOWN } } }
I20260928 20:14:49.847697 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.844767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59110 (local address 127.24.190.2:41379)
0928 20:14:49.844900 (+ 133us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.844902 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.844913 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:14:49.844946 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.844947 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.844962 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.845030 (+ 68us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:49.845248 (+ 218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.845799 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.846929 (+ 1130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.847138 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.847191 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.847385 (+ 194us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:49.847478 (+ 93us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:49.847531 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.847610 (+ 79us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.847625 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260928 20:14:49.847739 26993 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.844696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:41379 (local address 127.0.0.1:59110)
0928 20:14:49.844779 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.844790 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.844836 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.845066 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.845066 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.845068 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:49.845136 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.845139 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.845885 (+ 746us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.845886 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.846849 (+ 963us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.846853 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.847216 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.847217 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.847276 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.847294 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:49.847540 (+ 246us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:49.847548 (+ 8us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.847605 (+ 57us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.847658 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260928 20:14:49.849115 26888 raft_consensus.cc:1261] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Refusing update from remote peer 10ef1d3cbbd34038a7c9348eb7c6190c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:49.849164 26608 raft_consensus.cc:1261] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Refusing update from remote peer 10ef1d3cbbd34038a7c9348eb7c6190c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:49.849422 26962 consensus_queue.cc:1035] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:49.849570 26986 consensus_queue.cc:1035] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c [LEADER]: Connected to new peer: Peer: permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:49.850310 26974 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: TxnStatusTablet state changed. Reason: New leader 10ef1d3cbbd34038a7c9348eb7c6190c. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.850406 26974 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.850847 26960 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: TxnStatusTablet state changed. Reason: New leader 10ef1d3cbbd34038a7c9348eb7c6190c. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.850936 26960 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.851372 27003 mvcc.cc:205] Tried to move back new op lower bound from 7334406102419656704 to 7334406102372175872. Current Snapshot: MvccSnapshot[applied={T|T < 7334406102419656704}]
I20260928 20:14:49.851454 26962 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.851531 26962 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:14:49.851557 26974 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.851632 26974 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 742785ed01d9414d83e166b2eaa4824e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.852175 27004 mvcc.cc:205] Tried to move back new op lower bound from 7334406102419656704 to 7334406102372175872. Current Snapshot: MvccSnapshot[applied={T|T < 7334406102419656704 or (T in {7334406102419656704})}]
I20260928 20:14:49.852555 26962 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.852641 26962 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 10ef1d3cbbd34038a7c9348eb7c6190c: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:14:49.852852 26960 tablet_replica.cc:439] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 } } peers { permanent_uuid: "10ef1d3cbbd34038a7c9348eb7c6190c" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41379 } } peers { permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 } } }
I20260928 20:14:49.852936 26960 tablet_replica.cc:442] T 2334e5242bfa4931af6237a9c47c643f P 59d515529b4f444e81e5a1412cb4f84a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:49.858246 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.855895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59118 (local address 127.24.190.2:41379)
0928 20:14:49.855940 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.855942 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.856048 (+ 106us) server_negotiation.cc:407] Connection header received
0928 20:14:49.856113 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.856114 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.856135 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.856190 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:49.856305 (+ 115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.856796 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.857536 (+ 740us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.857744 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.857831 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.857992 (+ 161us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:49.858030 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:49.858090 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.858141 (+ 51us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.858163 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:14:49.863173 27002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.860787 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33153 (local address 127.24.190.2:41379)
0928 20:14:49.860825 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.860827 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.860957 (+ 130us) server_negotiation.cc:407] Connection header received
0928 20:14:49.861025 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.861025 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.861034 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.861086 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:49.861198 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.861639 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.862465 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.862643 (+ 178us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.862721 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.862896 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:49.862930 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:49.862989 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.863045 (+ 56us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.863079 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":13,"server-negotiator.queue_time_us":18}
I20260928 20:14:49.863195 27016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.860730 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:41379 (local address 127.24.190.2:33153)
0928 20:14:49.860891 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:49.860905 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:49.860979 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:49.861089 (+ 110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:49.861090 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:49.861091 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:49.861145 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.861146 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.861722 (+ 576us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.861723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.862378 (+ 655us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:49.862380 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.862722 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.862722 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:49.862786 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.862805 (+ 19us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:49.862988 (+ 183us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:49.862989 (+ 1us) client_negotiation.cc:769] Sending connection context
0928 20:14:49.863041 (+ 52us) client_negotiation.cc:240] Negotiation successful
0928 20:14:49.863095 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"mutex_wait_us":3,"thread_start_us":79,"threads_started":1}
I20260928 20:14:49.865608 26888 raft_consensus.cc:1261] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Refusing update from remote peer 10ef1d3cbbd34038a7c9348eb7c6190c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:49.865639 26608 raft_consensus.cc:1261] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Refusing update from remote peer 10ef1d3cbbd34038a7c9348eb7c6190c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:49.865809 26962 consensus_queue.cc:1035] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [LEADER]: Connected to new peer: Peer: permanent_uuid: "59d515529b4f444e81e5a1412cb4f84a" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38537 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:49.865937 27010 consensus_queue.cc:1035] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [LEADER]: Connected to new peer: Peer: permanent_uuid: "742785ed01d9414d83e166b2eaa4824e" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:49.868791 27006 mvcc.cc:205] Tried to move back new op lower bound from 7334406102488264704 to 7334406101845229568. Current Snapshot: MvccSnapshot[applied={T|T < 7334406102488264704}]
I20260928 20:14:49.880302 26451 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:49.880412 26451 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43052:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:49.881037 26451 catalog_manager.cc:5782] T 00000000000000000000000000000000 P b8bb1b49d2c34cefa6fa6e80e9ae2333: Sending DeleteTablet for 3 replicas of tablet 53ff4ab9689c4510ad9b594c5d066617
I20260928 20:14:49.881323 26588 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ff4ab9689c4510ad9b594c5d066617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:43396
I20260928 20:14:49.881399 26727 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ff4ab9689c4510ad9b594c5d066617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:59100
I20260928 20:14:49.881402 26868 tablet_service.cc:1514] Processing DeleteTablet for tablet 53ff4ab9689c4510ad9b594c5d066617 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:57568
I20260928 20:14:49.881575 27020 tablet_replica.cc:330] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: stopping tablet replica
I20260928 20:14:49.881630 27020 raft_consensus.cc:2229] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:49.881665 27020 raft_consensus.cc:2258] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:49.881758 27021 tablet_replica.cc:330] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: stopping tablet replica
I20260928 20:14:49.881811 27021 raft_consensus.cc:2229] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:14:49.881893 27021 raft_consensus.cc:2258] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:49.881915 27022 tablet_replica.cc:330] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: stopping tablet replica
I20260928 20:14:49.881978 27022 raft_consensus.cc:2229] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:49.882021 27022 raft_consensus.cc:2258] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:49.882091 27020 ts_tablet_manager.cc:1905] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:49.882315 27022 ts_tablet_manager.cc:1905] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:49.883913 27021 ts_tablet_manager.cc:1905] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:49.884121 27022 ts_tablet_manager.cc:1918] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:49.884217 27022 log.cc:1196] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/53ff4ab9689c4510ad9b594c5d066617
I20260928 20:14:49.884564 27022 ts_tablet_manager.cc:1939] T 53ff4ab9689c4510ad9b594c5d066617 P 59d515529b4f444e81e5a1412cb4f84a: Deleting consensus metadata
I20260928 20:14:49.884933 26437 catalog_manager.cc:4841] TS 59d515529b4f444e81e5a1412cb4f84a (127.24.190.3:38537): tablet 53ff4ab9689c4510ad9b594c5d066617 (table test-table [id=8ad5cf6727e941fd9eb89ee3b83e18b7]) successfully deleted
I20260928 20:14:49.885692 27021 ts_tablet_manager.cc:1918] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:49.885752 27021 log.cc:1196] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/53ff4ab9689c4510ad9b594c5d066617
I20260928 20:14:49.885987 27021 ts_tablet_manager.cc:1939] T 53ff4ab9689c4510ad9b594c5d066617 P 10ef1d3cbbd34038a7c9348eb7c6190c: Deleting consensus metadata
I20260928 20:14:49.886178 27020 ts_tablet_manager.cc:1918] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:49.886224 27020 log.cc:1196] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/53ff4ab9689c4510ad9b594c5d066617
I20260928 20:14:49.886415 26438 catalog_manager.cc:4841] TS 10ef1d3cbbd34038a7c9348eb7c6190c (127.24.190.2:41379): tablet 53ff4ab9689c4510ad9b594c5d066617 (table test-table [id=8ad5cf6727e941fd9eb89ee3b83e18b7]) successfully deleted
I20260928 20:14:49.886471 27020 ts_tablet_manager.cc:1939] T 53ff4ab9689c4510ad9b594c5d066617 P 742785ed01d9414d83e166b2eaa4824e: Deleting consensus metadata
I20260928 20:14:49.886744 26437 catalog_manager.cc:4841] TS 742785ed01d9414d83e166b2eaa4824e (127.24.190.1:45623): tablet 53ff4ab9689c4510ad9b594c5d066617 (table test-table [id=8ad5cf6727e941fd9eb89ee3b83e18b7]) successfully deleted
Sep 28 20:14:49 dist-test-slave-n45k krb5kdc[26406](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626488, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:14:49.891716 26953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.882289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.24.190.1:45623)
0928 20:14:49.882329 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.882331 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.882569 (+ 238us) server_negotiation.cc:407] Connection header received
0928 20:14:49.882665 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.882666 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.882676 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.882703 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:49.883471 (+ 768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.884181 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.885231 (+ 1050us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.885461 (+ 230us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.885551 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.888672 (+ 3121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:49.888682 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:49.888683 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:49.888690 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:49.890403 (+ 1713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:49.890823 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:49.890826 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:49.890826 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:49.890886 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:49.891087 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:49.891088 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:49.891088 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:49.891278 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:49.891428 (+ 150us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.891490 (+ 62us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.891571 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 20:14:49.892026 26648 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43410
I20260928 20:14:49.900130 26994 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:49.893017 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43076 (local address 127.24.190.62:46159)
0928 20:14:49.893063 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:49.893066 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:49.893120 (+ 54us) server_negotiation.cc:407] Connection header received
0928 20:14:49.893176 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:49.893177 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:49.893187 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:49.893253 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:49.893709 (+ 456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.894538 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.895216 (+ 678us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:49.895531 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:49.895653 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:49.897343 (+ 1690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:49.897344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:49.897345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:49.897352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:49.898965 (+ 1613us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:49.899371 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:49.899372 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:49.899372 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:49.899437 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:49.899615 (+ 178us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:49.899616 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:49.899616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:49.899751 (+ 135us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:49.899854 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:49.899943 (+ 89us) server_negotiation.cc:299] Negotiation successful
0928 20:14:49.900031 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
W20260928 20:14:49.900354 26451 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43076
I20260928 20:14:49.900949 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 26523
I20260928 20:14:49.917835 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 26663
I20260928 20:14:49.930085 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 26803
I20260928 20:14:49.934836 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 26419
2026-09-28T20:14:49Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (2936 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:49 dist-test-slave-n45k krb5kdc[27029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:49 dist-test-slave-n45k krb5kdc[27029](info): set up 2 sockets
Sep 28 20:14:49 dist-test-slave-n45k krb5kdc[27029](info): commencing operation
krb5kdc: starting...
W20260928 20:14:51.018572 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.062s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:51.142441 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39469
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:39469
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:51.225180 27042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:51.225446 27042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:51.225486 27042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:51.226716 27042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:14:51.226809 27042 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260928 20:14:51.226835 27042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:51.226857 27042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:51.226882 27042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:14:51.226895 27042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:14:51.228382 27042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:39469
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39469
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:51.228579 27042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:51.228749 27042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:51.233819 27050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.233785 27048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.234114 27047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:51.234457 27042 server_base.cc:1034] running on GCE node
I20260928 20:14:51.234699 27042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:51.235014 27042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:51.236189 27042 hybrid_clock.cc:648] HybridClock initialized: now 1790626491236165 us; error 40 us; skew 500 ppm
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:51.239089 27042 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:14:51.239600 27042 webserver.cc:460] Webserver started at http://127.24.190.62:42179/ using document root <none> and password file <none>
I20260928 20:14:51.239831 27042 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:51.239888 27042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:51.240065 27042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:51.241186 27042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "64f41f11828247f08b70a7436bbc3469"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "efcb0e41462327575f67c97fa617731c"
server_key_iv: "4a596ecdf2aa2f25185cdb7d60523fc6"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.241568 27042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "64f41f11828247f08b70a7436bbc3469"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "efcb0e41462327575f67c97fa617731c"
server_key_iv: "4a596ecdf2aa2f25185cdb7d60523fc6"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.243033 27042 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:14:51.243806 27057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.244001 27042 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:51.244091 27042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "64f41f11828247f08b70a7436bbc3469"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "efcb0e41462327575f67c97fa617731c"
server_key_iv: "4a596ecdf2aa2f25185cdb7d60523fc6"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.244164 27042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:51.257481 27042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:51.259745 27042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:51.259896 27042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:51.264580 27042 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:39469
I20260928 20:14:51.264639 27119 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:39469 every 8 connection(s)
I20260928 20:14:51.264974 27042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:14:51.265592 27120 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:51.267477 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27042
I20260928 20:14:51.267575 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:14:51.267726 25336 external_mini_cluster.cc:1428] Setting key c5e1246b6c090d7d754de3558c3d5936
I20260928 20:14:51.268421 27120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Bootstrap starting.
I20260928 20:14:51.269001 27120 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:51.269279 27120 log.cc:824] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:51.269994 27120 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: No bootstrap required, opened a new log
I20260928 20:14:51.271842 27120 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64f41f11828247f08b70a7436bbc3469" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39469 } }
I20260928 20:14:51.272023 27120 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:51.272090 27120 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64f41f11828247f08b70a7436bbc3469, State: Initialized, Role: FOLLOWER
I20260928 20:14:51.272267 27120 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64f41f11828247f08b70a7436bbc3469" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39469 } }
I20260928 20:14:51.272357 27120 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:14:51.272390 27120 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:14:51.272442 27120 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:51.273059 27120 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64f41f11828247f08b70a7436bbc3469" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39469 } }
I20260928 20:14:51.273154 27120 leader_election.cc:302] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64f41f11828247f08b70a7436bbc3469; no voters:
I20260928 20:14:51.273301 27120 leader_election.cc:288] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:14:51.273330 27125 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:51.273460 27125 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [term 1 LEADER]: Becoming Leader. State: Replica: 64f41f11828247f08b70a7436bbc3469, State: Running, Role: LEADER
I20260928 20:14:51.273540 27125 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64f41f11828247f08b70a7436bbc3469" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39469 } }
I20260928 20:14:51.273569 27120 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:14:51.273948 27127 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64f41f11828247f08b70a7436bbc3469. Latest consensus state: current_term: 1 leader_uuid: "64f41f11828247f08b70a7436bbc3469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64f41f11828247f08b70a7436bbc3469" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39469 } } }
I20260928 20:14:51.273948 27126 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64f41f11828247f08b70a7436bbc3469" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64f41f11828247f08b70a7436bbc3469" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39469 } } }
I20260928 20:14:51.274101 27127 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:51.274111 27126 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:51.274475 27134 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:14:51.275028 27134 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:14:51.276552 27134 catalog_manager.cc:1347] Generated new cluster ID: a1587cba6f834224b7e05410ed2b3742
I20260928 20:14:51.276612 27134 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:51.284359 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.268240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53250 (local address 127.24.190.62:39469)
0928 20:14:51.268430 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.268438 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.268464 (+ 26us) server_negotiation.cc:407] Connection header received
0928 20:14:51.268925 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.268931 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.268978 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.269135 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.269924 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.270932 (+ 1008us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.271687 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.272152 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.272283 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.280122 (+ 7839us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.280126 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.280127 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.280149 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.282645 (+ 2496us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.283084 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.283087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.283087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.283192 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.283413 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.283413 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.283414 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.283711 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.283853 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.284017 (+ 164us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.284148 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":81,"threads_started":1}
I20260928 20:14:51.290217 27134 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:14:51.291006 27134 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:14:51.296931 27134 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Generated new TSK 0
I20260928 20:14:51.297152 27134 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:14:51.329685 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39469
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:51.411525 27146 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:51.411736 27146 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:51.411762 27146 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:51.412937 27146 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:51.412981 27146 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:51.413002 27146 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260928 20:14:51.413055 27146 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:14:51.413086 27146 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:14:51.414659 27146 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:39469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27146
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:51.414917 27146 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:51.415161 27146 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:51.420347 27154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.420468 27152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:51.420622 27146 server_base.cc:1034] running on GCE node
W20260928 20:14:51.420691 27151 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:51.420933 27146 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:51.421154 27146 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:51.422340 27146 hybrid_clock.cc:648] HybridClock initialized: now 1790626491422325 us; error 28 us; skew 500 ppm
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:51.424786 27146 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:14:51.425216 27146 webserver.cc:460] Webserver started at http://127.24.190.1:38281/ using document root <none> and password file <none>
I20260928 20:14:51.425453 27146 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:51.425521 27146 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:51.425673 27146 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:51.426796 27146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "c68cbf7449ba483fa59267818f94442b"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "e3047ac8c80d212871fe2da873a2c230"
server_key_iv: "b5deabd162badb97b436518ba7cf0225"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.427162 27146 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "c68cbf7449ba483fa59267818f94442b"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "e3047ac8c80d212871fe2da873a2c230"
server_key_iv: "b5deabd162badb97b436518ba7cf0225"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.428499 27146 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:14:51.429270 27161 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.429469 27146 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:51.429579 27146 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c68cbf7449ba483fa59267818f94442b"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "e3047ac8c80d212871fe2da873a2c230"
server_key_iv: "b5deabd162badb97b436518ba7cf0225"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.429653 27146 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:51.443603 27146 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:51.445426 27146 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:51.445582 27146 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:51.446097 27146 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:51.446161 27146 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.446221 27146 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:51.446251 27146 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.453081 27146 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:37865
I20260928 20:14:51.453150 27276 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:37865 every 8 connection(s)
I20260928 20:14:51.453478 27146 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:51.454728 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27146
I20260928 20:14:51.454838 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:14:51.455070 25336 external_mini_cluster.cc:1428] Setting key c92e50e2e2270b025bd407825988e81a
I20260928 20:14:51.457034 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.446685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:47401 (local address 127.24.190.62:39469)
0928 20:14:51.446730 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.446732 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.447008 (+ 276us) server_negotiation.cc:407] Connection header received
0928 20:14:51.447537 (+ 529us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.447538 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.447552 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.447623 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.448530 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.449398 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.450948 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.451304 (+ 356us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.451383 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.454067 (+ 2684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.454068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.454068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.454075 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.455628 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.456048 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.456049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.456050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.456111 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.456344 (+ 233us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.456345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.456345 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.456492 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.456562 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.456796 (+ 234us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.456900 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:14:51.457166 27170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.446692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.24.190.1:47401)
0928 20:14:51.446852 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.446917 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.447422 (+ 505us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.447708 (+ 286us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.447717 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.448086 (+ 369us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:51.448416 (+ 330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.448423 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.449506 (+ 1083us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.449508 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.450868 (+ 1360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.450872 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.451390 (+ 518us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.451392 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.451525 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.452141 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:51.452150 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:51.453989 (+ 1839us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:51.455703 (+ 1714us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.455709 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.455711 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.455972 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.456181 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.456182 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.456182 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.456280 (+ 98us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.456554 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:51.456558 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:51.456666 (+ 108us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.456746 (+ 80us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.456912 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":100,"threads_started":1}
I20260928 20:14:51.457752 27277 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39469
I20260928 20:14:51.457851 27277 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:51.458040 27277 heartbeater.cc:511] Master 127.24.190.62:39469 requested a full tablet report, sending...
I20260928 20:14:51.458606 27073 ts_manager.cc:194] Registered new tserver with Master: c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865)
I20260928 20:14:51.459571 27073 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:47401
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:14:51.464592 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.458860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:59053 (local address 127.24.190.62:39469)
0928 20:14:51.458895 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.458897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.458935 (+ 38us) server_negotiation.cc:407] Connection header received
0928 20:14:51.459005 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.459006 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.459016 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.459069 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.459387 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.460053 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.460847 (+ 794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.461053 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.461134 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.462082 (+ 948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.462084 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.462084 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.462090 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.463464 (+ 1374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.463820 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.463821 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.463822 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.463881 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.464083 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.464084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.464085 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.464194 (+ 109us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.464267 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.464431 (+ 164us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.464501 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:14:51.464600 27284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.458710 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.24.190.1:59053)
0928 20:14:51.458824 (+ 114us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.458891 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.458950 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.459074 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.459074 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.459247 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:51.459293 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.459295 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.460171 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.460172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.460761 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.460763 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.461136 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.461137 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.461215 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.461700 (+ 485us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:51.461705 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:51.461979 (+ 274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:51.463563 (+ 1584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.463564 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.463565 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.463735 (+ 170us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.463955 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.463955 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.463956 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.464019 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.464270 (+ 251us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:51.464271 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:51.464314 (+ 43us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.464404 (+ 90us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.464503 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":88,"mutex_wait_us":35,"thread_start_us":65,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:14:51.481462 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39469
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:51.563040 27286 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:51.563259 27286 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:51.563284 27286 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:51.564375 27286 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:51.564410 27286 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:51.564430 27286 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260928 20:14:51.564442 27286 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:14:51.564459 27286 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:14:51.565909 27286 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:39469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27286
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:51.566088 27286 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:51.566259 27286 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:51.571205 27294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.571228 27291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.571205 27292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:51.571511 27286 server_base.cc:1034] running on GCE node
I20260928 20:14:51.571679 27286 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:51.571880 27286 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:51.573004 27286 hybrid_clock.cc:648] HybridClock initialized: now 1790626491572994 us; error 27 us; skew 500 ppm
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:51.575613 27286 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:14:51.576116 27286 webserver.cc:460] Webserver started at http://127.24.190.2:43889/ using document root <none> and password file <none>
I20260928 20:14:51.576341 27286 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:51.576413 27286 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:51.576546 27286 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:51.577611 27286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "12b9fe5292ac4939a56922076197cb31"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "08cd51ab78fad23fe326145fb5038444"
server_key_iv: "51539505a32ccad6a55f5a742f5e8a07"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.577971 27286 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "12b9fe5292ac4939a56922076197cb31"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "08cd51ab78fad23fe326145fb5038444"
server_key_iv: "51539505a32ccad6a55f5a742f5e8a07"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.579401 27286 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:14:51.580097 27301 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.580272 27286 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:14:51.580375 27286 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "12b9fe5292ac4939a56922076197cb31"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "08cd51ab78fad23fe326145fb5038444"
server_key_iv: "51539505a32ccad6a55f5a742f5e8a07"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.580454 27286 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:51.596650 27286 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:51.599102 27286 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:51.599221 27286 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:51.599699 27286 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:51.599741 27286 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.599764 27286 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:51.599777 27286 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.606643 27286 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:43543
I20260928 20:14:51.606801 27416 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:43543 every 8 connection(s)
I20260928 20:14:51.607076 27286 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:51.610584 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.600232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38265 (local address 127.24.190.62:39469)
0928 20:14:51.600286 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.600288 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.600464 (+ 176us) server_negotiation.cc:407] Connection header received
0928 20:14:51.601017 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.601019 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.601032 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.601117 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.602122 (+ 1005us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.602975 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.604674 (+ 1699us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.604934 (+ 260us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.604992 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.607811 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.607813 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.607813 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.607821 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.609175 (+ 1354us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.609577 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.609579 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.609579 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.609635 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.609904 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.609905 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.609905 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.610022 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.610091 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.610414 (+ 323us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.610493 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 20:14:51.610790 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.600159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.24.190.2:38265)
0928 20:14:51.600350 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.600391 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.600902 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.601264 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.601269 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.601693 (+ 424us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:51.602005 (+ 312us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.602012 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.603081 (+ 1069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.603082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.604580 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.604583 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.605026 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.605026 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.605211 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.605796 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:51.605807 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:51.607659 (+ 1852us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:51.609270 (+ 1611us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.609277 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.609279 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.609500 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.609709 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.609709 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.609710 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.609828 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.610091 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:51.610098 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:51.610236 (+ 138us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.610381 (+ 145us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.610538 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":94,"threads_started":1}
I20260928 20:14:51.611320 27417 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39469
I20260928 20:14:51.611402 27417 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:51.611581 27417 heartbeater.cc:511] Master 127.24.190.62:39469 requested a full tablet report, sending...
I20260928 20:14:51.611984 27073 ts_manager.cc:194] Registered new tserver with Master: 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543)
I20260928 20:14:51.612533 27073 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:38265
I20260928 20:14:51.616566 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27286
I20260928 20:14:51.616642 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:14:51.616861 25336 external_mini_cluster.cc:1428] Setting key 22e77b8152d0f815c90c3e759f29ae6e
I20260928 20:14:51.617928 27423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.612396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.24.190.2:33731)
0928 20:14:51.612565 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.612574 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.612647 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.612793 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.612794 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.612996 (+ 202us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:51.613053 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.613054 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.613681 (+ 627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.613682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.614155 (+ 473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.614157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.614565 (+ 408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.614565 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.614621 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.614990 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:51.614994 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:51.615243 (+ 249us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:51.616833 (+ 1590us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.616834 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.616835 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.617062 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.617279 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.617280 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.617280 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.617343 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.617680 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:51.617681 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:51.617726 (+ 45us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.617779 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.617859 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":74,"threads_started":1}
I20260928 20:14:51.618054 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.612430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33731 (local address 127.24.190.62:39469)
0928 20:14:51.612464 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.612465 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.612641 (+ 176us) server_negotiation.cc:407] Connection header received
0928 20:14:51.612703 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.612704 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.612715 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.612789 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.613143 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.613594 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.614245 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.614502 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.614554 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.615323 (+ 769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.615324 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.615324 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.615330 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.616740 (+ 1410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.617147 (+ 407us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.617148 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.617148 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.617208 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.617420 (+ 212us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.617421 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.617421 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.617608 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.617686 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.617833 (+ 147us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.617915 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:14:51.641935 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39469
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44967
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:51.724944 27426 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:51.725157 27426 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:51.725183 27426 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:51.726531 27426 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:51.726573 27426 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:51.726594 27426 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260928 20:14:51.726627 27426 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:14:51.726661 27426 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:14:51.728190 27426 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44967
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:39469
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27426
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:51.728471 27426 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:51.728714 27426 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:14:51.734128 27426 server_base.cc:1034] running on GCE node
W20260928 20:14:51.734050 27432 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.734050 27434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:51.734072 27431 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:51.734557 27426 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:51.734846 27426 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:51.736016 27426 hybrid_clock.cc:648] HybridClock initialized: now 1790626491736012 us; error 37 us; skew 500 ppm
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:51.738524 27426 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:14:51.738996 27426 webserver.cc:460] Webserver started at http://127.24.190.3:37099/ using document root <none> and password file <none>
I20260928 20:14:51.739243 27426 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:51.739311 27426 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:51.739488 27426 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:51.740581 27426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "f851db96f7f44c34a40d8b6d299938e3"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "7f3a0a8c3b11ab5d6991ccd91e6a8500"
server_key_iv: "4402f7a911ad25adc2c0766257c28386"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.740970 27426 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "f851db96f7f44c34a40d8b6d299938e3"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "7f3a0a8c3b11ab5d6991ccd91e6a8500"
server_key_iv: "4402f7a911ad25adc2c0766257c28386"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.742362 27426 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.003s
I20260928 20:14:51.743160 27441 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.743355 27426 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:51.743459 27426 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "f851db96f7f44c34a40d8b6d299938e3"
format_stamp: "Formatted at 2026-09-28 20:14:51 on dist-test-slave-n45k"
server_key: "7f3a0a8c3b11ab5d6991ccd91e6a8500"
server_key_iv: "4402f7a911ad25adc2c0766257c28386"
server_key_version: "encryptionkey@0"
I20260928 20:14:51.743533 27426 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:51.758651 27426 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:51.760877 27426 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:51.761046 27426 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:51.761649 27426 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:51.761701 27426 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:51.761730 27426 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:51.761751 27426 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:51.769009 27426 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:41969
I20260928 20:14:51.769069 27556 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:41969 every 8 connection(s)
I20260928 20:14:51.769449 27426 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:14:51.771400 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.762096 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:35937 (local address 127.24.190.62:39469)
0928 20:14:51.762143 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.762145 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.762402 (+ 257us) server_negotiation.cc:407] Connection header received
0928 20:14:51.762904 (+ 502us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.762905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.762919 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.762998 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.763771 (+ 773us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.764317 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.765338 (+ 1021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.765539 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.765627 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.768516 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.768518 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.768518 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.768526 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.770098 (+ 1572us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.770554 (+ 456us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.770555 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.770555 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.770608 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.770865 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.770866 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.770866 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.770969 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.771018 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.771242 (+ 224us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.771303 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:14:51.771521 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.762075 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.24.190.3:35937)
0928 20:14:51.762229 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.762302 (+ 73us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.762802 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.763055 (+ 253us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.763058 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.763465 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:51.763668 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.763675 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.764415 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.764416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.765240 (+ 824us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.765242 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.765636 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.765637 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.765803 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.766374 (+ 571us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:51.766382 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:51.768403 (+ 2021us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:51.770174 (+ 1771us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.770181 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.770183 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.770486 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.770706 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.770706 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.770707 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.770801 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.771018 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:51.771022 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:51.771134 (+ 112us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.771209 (+ 75us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.771326 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":88,"threads_started":1}
I20260928 20:14:51.771965 27557 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39469
I20260928 20:14:51.772043 27557 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:51.772230 27557 heartbeater.cc:511] Master 127.24.190.62:39469 requested a full tablet report, sending...
I20260928 20:14:51.772570 27074 ts_manager.cc:194] Registered new tserver with Master: f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:51.773056 27074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:35937
I20260928 20:14:51.777482 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27426
I20260928 20:14:51.777593 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:14:51.777814 25336 external_mini_cluster.cc:1428] Setting key 551020a6113b817743bbe6f33440af2a
I20260928 20:14:51.778759 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:14:51.779522 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.773057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:44051 (local address 127.24.190.62:39469)
0928 20:14:51.773105 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.773107 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.773274 (+ 167us) server_negotiation.cc:407] Connection header received
0928 20:14:51.773816 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.773817 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.773828 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.773890 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.774295 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.775084 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.775777 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.775973 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.776038 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.776875 (+ 837us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.776876 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.776876 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.776882 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.778407 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.778758 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.778759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.778760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.778816 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.779024 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.779025 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.779025 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.779128 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.779205 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.779362 (+ 157us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.779432 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 20:14:51.779528 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.772970 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.24.190.3:44051)
0928 20:14:51.773145 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.773156 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.773278 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.773925 (+ 647us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.773926 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.774124 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:51.774177 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.774179 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.775185 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.775186 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.775702 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.775703 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.776044 (+ 341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.776044 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.776100 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.776510 (+ 410us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:51.776514 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:51.776778 (+ 264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:51.778501 (+ 1723us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.778502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.778502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.778675 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.778898 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:51.778899 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:51.778900 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:51.778961 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:51.779196 (+ 235us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:51.779197 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:51.779242 (+ 45us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.779320 (+ 78us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.779434 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":72,"threads_started":1}
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 28 20:14:51 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:51.800800 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.794246 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53262 (local address 127.24.190.62:39469)
0928 20:14:51.794338 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.794340 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.794358 (+ 18us) server_negotiation.cc:407] Connection header received
0928 20:14:51.794381 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.794382 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.794390 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.794445 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:51.794949 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.795431 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.796107 (+ 676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.796289 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.796341 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.798594 (+ 2253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:51.798596 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:51.798596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:51.798602 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:51.799767 (+ 1165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.800085 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.800086 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.800087 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.800155 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:51.800361 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:51.800362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:51.800362 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:51.800468 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:51.800543 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.800674 (+ 131us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.800736 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260928 20:14:51.802575 27074 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:14:51.804102 27074 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:51.810448 27574 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.806239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.0.0.1:48126)
0928 20:14:51.806597 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.806607 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.806693 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.806927 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.806928 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.806930 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:51.806972 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.806974 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.807956 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.807957 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.809439 (+ 1482us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.809440 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.810091 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.810092 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.810173 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.810186 (+ 13us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.810279 (+ 93us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.810358 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":5,"thread_start_us":82,"threads_started":1}
I20260928 20:14:51.810454 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.806389 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48126 (local address 127.24.190.2:43543)
0928 20:14:51.806551 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.806555 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.806667 (+ 112us) server_negotiation.cc:407] Connection header received
0928 20:14:51.806780 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.806782 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.806796 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.806845 (+ 49us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:51.807044 (+ 199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.807859 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.809515 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.809990 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.810077 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.810138 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.810311 (+ 173us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.810349 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260928 20:14:51.810652 27575 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.806239 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:41969 (local address 127.0.0.1:60634)
0928 20:14:51.806416 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.806455 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.806518 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.806782 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.806786 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.806797 (+ 11us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:51.806877 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.806879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.808171 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.808172 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.809239 (+ 1067us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.809242 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.810379 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.810380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.810428 (+ 48us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.810431 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.810504 (+ 73us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.810553 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":67,"threads_started":1}
I20260928 20:14:51.810949 27578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.806464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37865 (local address 127.0.0.1:48086)
0928 20:14:51.806670 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.806679 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.806725 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.807243 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.807244 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.807246 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:51.807282 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.807283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.808441 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.808442 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.809158 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.809160 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.810748 (+ 1588us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.810749 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.810805 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.810809 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.810859 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.810892 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":70,"threads_started":1}
I20260928 20:14:51.811106 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.806665 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48086 (local address 127.24.190.1:37865)
0928 20:14:51.806840 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.806843 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.806858 (+ 15us) server_negotiation.cc:407] Connection header received
0928 20:14:51.806888 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.806890 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.806900 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.806998 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:51.807370 (+ 372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.808351 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.809249 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.809984 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.810086 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.810140 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.810882 (+ 742us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.810926 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":74,"threads_started":1}
I20260928 20:14:51.811396 27576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.806360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60634 (local address 127.24.190.3:41969)
0928 20:14:51.806545 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.806551 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.806562 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:14:51.806606 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.806609 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.806628 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.806708 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:51.807021 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.808077 (+ 1056us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.809304 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.809984 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.810087 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.810140 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.811121 (+ 981us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.811165 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":79,"threads_started":1}
I20260928 20:14:51.811385 27349 tablet_service.cc:1467] Processing CreateTablet for tablet fc191c3473964627b8897c1986413ea4 (DEFAULT_TABLE table=test-table [id=74c6a71444ef4190acf8eb13a874690f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:51.811822 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc191c3473964627b8897c1986413ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:51.811987 27491 tablet_service.cc:1467] Processing CreateTablet for tablet fc191c3473964627b8897c1986413ea4 (DEFAULT_TABLE table=test-table [id=74c6a71444ef4190acf8eb13a874690f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:51.812290 27491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc191c3473964627b8897c1986413ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:51.814872 27580 tablet_bootstrap.cc:492] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Bootstrap starting.
I20260928 20:14:51.814931 27211 tablet_service.cc:1467] Processing CreateTablet for tablet fc191c3473964627b8897c1986413ea4 (DEFAULT_TABLE table=test-table [id=74c6a71444ef4190acf8eb13a874690f]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:51.815208 27581 tablet_bootstrap.cc:492] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Bootstrap starting.
I20260928 20:14:51.815251 27211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fc191c3473964627b8897c1986413ea4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:51.815606 27580 tablet_bootstrap.cc:654] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:51.815791 27581 tablet_bootstrap.cc:654] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:51.815834 27580 log.cc:824] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:51.816093 27581 log.cc:824] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:51.816532 27580 tablet_bootstrap.cc:492] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: No bootstrap required, opened a new log
I20260928 20:14:51.816589 27580 ts_tablet_manager.cc:1397] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:51.816823 27581 tablet_bootstrap.cc:492] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: No bootstrap required, opened a new log
I20260928 20:14:51.816879 27581 ts_tablet_manager.cc:1397] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:51.817994 27580 raft_consensus.cc:348] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.818105 27580 raft_consensus.cc:374] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:51.818125 27580 raft_consensus.cc:729] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Initialized, Role: FOLLOWER
I20260928 20:14:51.818243 27580 consensus_queue.cc:260] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.818553 27580 ts_tablet_manager.cc:1428] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:14:51.818684 27557 heartbeater.cc:503] Master 127.24.190.62:39469 was elected leader, sending a full tablet report...
I20260928 20:14:51.818986 27581 raft_consensus.cc:348] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.819149 27581 raft_consensus.cc:374] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:51.819195 27581 raft_consensus.cc:729] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Initialized, Role: FOLLOWER
I20260928 20:14:51.819296 27581 consensus_queue.cc:260] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.819357 27585 tablet_bootstrap.cc:492] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Bootstrap starting.
I20260928 20:14:51.819561 27581 ts_tablet_manager.cc:1428] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:14:51.819581 27417 heartbeater.cc:503] Master 127.24.190.62:39469 was elected leader, sending a full tablet report...
I20260928 20:14:51.820201 27585 tablet_bootstrap.cc:654] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:51.820523 27585 log.cc:824] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:51.821179 27585 tablet_bootstrap.cc:492] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: No bootstrap required, opened a new log
I20260928 20:14:51.821261 27585 ts_tablet_manager.cc:1397] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:51.822717 27585 raft_consensus.cc:348] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.822908 27585 raft_consensus.cc:374] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:51.822959 27585 raft_consensus.cc:729] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c68cbf7449ba483fa59267818f94442b, State: Initialized, Role: FOLLOWER
I20260928 20:14:51.823072 27585 consensus_queue.cc:260] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.823328 27585 ts_tablet_manager.cc:1428] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:14:51.823383 27277 heartbeater.cc:503] Master 127.24.190.62:39469 was elected leader, sending a full tablet report...
W20260928 20:14:51.857652 27418 tablet.cc:2369] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:14:51.954206 27278 tablet.cc:2369] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:14:51.956085 27584 raft_consensus.cc:482] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:51.956246 27584 raft_consensus.cc:504] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.956625 27584 leader_election.cc:288] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543)
I20260928 20:14:51.959759 27450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.956771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37865 (local address 127.24.190.3:55913)
0928 20:14:51.956828 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.956840 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.956885 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.957073 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.957074 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.957077 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:51.957155 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.957157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.957926 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.957927 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.958867 (+ 940us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.958870 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.959495 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.959496 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.959581 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.959586 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.959641 (+ 55us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.959670 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38,"mutex_wait_us":47}
I20260928 20:14:51.959782 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.956879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:55913 (local address 127.24.190.1:37865)
0928 20:14:51.956922 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.956924 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.956933 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:14:51.956961 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.956962 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.956972 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.957033 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:51.957235 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.957833 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.958948 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.959438 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.959495 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.959503 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.959667 (+ 164us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.959707 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:14:51.959880 27589 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.956804 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.24.190.3:48631)
0928 20:14:51.956993 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:51.957001 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:51.957049 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:51.957176 (+ 127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:51.957176 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:51.957178 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:51.957304 (+ 126us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.957306 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.958021 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.958021 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.958965 (+ 944us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:51.958967 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.959584 (+ 617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.959585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:51.959675 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.959679 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:14:51.959736 (+ 57us) client_negotiation.cc:240] Negotiation successful
0928 20:14:51.959773 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":174,"thread_start_us":106,"threads_started":1}
I20260928 20:14:51.959877 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:51.956902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48631 (local address 127.24.190.2:43543)
0928 20:14:51.956948 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:51.956950 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:51.957061 (+ 111us) server_negotiation.cc:407] Connection header received
0928 20:14:51.957091 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:51.957092 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:51.957101 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:51.957175 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:51.957417 (+ 242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.957941 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.959053 (+ 1112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:51.959495 (+ 442us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:51.959569 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:51.959578 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:51.959761 (+ 183us) server_negotiation.cc:299] Negotiation successful
0928 20:14:51.959809 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:14:51.960182 27231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc191c3473964627b8897c1986413ea4" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b" is_pre_election: true
I20260928 20:14:51.960237 27371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc191c3473964627b8897c1986413ea4" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b9fe5292ac4939a56922076197cb31" is_pre_election: true
I20260928 20:14:51.960332 27231 raft_consensus.cc:2454] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 0.
I20260928 20:14:51.960398 27371 raft_consensus.cc:2454] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 0.
I20260928 20:14:51.960558 27445 leader_election.cc:302] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c68cbf7449ba483fa59267818f94442b, f851db96f7f44c34a40d8b6d299938e3; no voters:
I20260928 20:14:51.960709 27584 raft_consensus.cc:2781] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:51.960810 27584 raft_consensus.cc:482] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:51.960841 27584 raft_consensus.cc:3037] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:51.961546 27584 raft_consensus.cc:504] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.961701 27584 leader_election.cc:288] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 election: Requested vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543)
I20260928 20:14:51.961848 27231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc191c3473964627b8897c1986413ea4" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b"
I20260928 20:14:51.961850 27371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc191c3473964627b8897c1986413ea4" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b9fe5292ac4939a56922076197cb31"
I20260928 20:14:51.961922 27231 raft_consensus.cc:3037] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:51.961946 27371 raft_consensus.cc:3037] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:51.962662 27231 raft_consensus.cc:2454] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 1.
I20260928 20:14:51.962740 27371 raft_consensus.cc:2454] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 1.
I20260928 20:14:51.962819 27445 leader_election.cc:302] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c68cbf7449ba483fa59267818f94442b, f851db96f7f44c34a40d8b6d299938e3; no voters:
I20260928 20:14:51.962917 27584 raft_consensus.cc:2781] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:51.963076 27584 raft_consensus.cc:686] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 1 LEADER]: Becoming Leader. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Running, Role: LEADER
I20260928 20:14:51.963161 27584 consensus_queue.cc:237] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } }
I20260928 20:14:51.964059 27074 catalog_manager.cc:5495] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3). New cstate: current_term: 1 leader_uuid: "f851db96f7f44c34a40d8b6d299938e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } health_report { overall_health: UNKNOWN } } }
Sep 28 20:14:52 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626491, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:52.009690 27597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.002958 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39469 (local address 127.0.0.1:53268)
0928 20:14:52.003187 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:52.003197 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:52.003280 (+ 83us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:52.003457 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:52.003458 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:52.003782 (+ 324us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:52.003827 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.003829 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.004501 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.004502 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.005026 (+ 524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.005028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.005375 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.005376 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.005427 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.005923 (+ 496us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:52.005928 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:52.007381 (+ 1453us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:52.008730 (+ 1349us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:52.008736 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:52.008738 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:52.008937 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:52.009100 (+ 163us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:52.009101 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:52.009101 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:52.009154 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:52.009418 (+ 264us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:52.009423 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:52.009464 (+ 41us) client_negotiation.cc:769] Sending connection context
0928 20:14:52.009516 (+ 52us) client_negotiation.cc:240] Negotiation successful
0928 20:14:52.009600 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":197,"thread_start_us":122,"threads_started":1}
I20260928 20:14:52.009797 27123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.003064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53268 (local address 127.24.190.62:39469)
0928 20:14:52.003147 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.003149 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.003260 (+ 111us) server_negotiation.cc:407] Connection header received
0928 20:14:52.003353 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.003354 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.003365 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.003449 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:52.003926 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.004418 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.005119 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.005301 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.005377 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.007466 (+ 2089us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:52.007467 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:52.007467 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:52.007473 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:52.008655 (+ 1182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:52.008997 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:52.008998 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:52.008998 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:52.009044 (+ 46us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:52.009237 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:52.009238 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:52.009239 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:52.009353 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:52.009418 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.009553 (+ 135us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.009670 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":29,"server-negotiator.queue_time_us":54}
I20260928 20:14:52.011938 27074 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:53268:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260928 20:14:52.012140 27074 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:52.013727 27349 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff63ae893974ebfbd9373343cb5907f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b433c4b7c18045f8a952152a6b2f5863]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:14:52.013789 27491 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff63ae893974ebfbd9373343cb5907f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b433c4b7c18045f8a952152a6b2f5863]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:14:52.013761 27211 tablet_service.cc:1467] Processing CreateTablet for tablet 3ff63ae893974ebfbd9373343cb5907f (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=b433c4b7c18045f8a952152a6b2f5863]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:14:52.013921 27491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff63ae893974ebfbd9373343cb5907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:52.013921 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff63ae893974ebfbd9373343cb5907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:52.013933 27211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3ff63ae893974ebfbd9373343cb5907f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:52.015250 27585 tablet_bootstrap.cc:492] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: Bootstrap starting.
I20260928 20:14:52.015498 27581 tablet_bootstrap.cc:492] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: Bootstrap starting.
I20260928 20:14:52.015657 27585 tablet_bootstrap.cc:654] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:52.015913 27580 tablet_bootstrap.cc:492] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: Bootstrap starting.
I20260928 20:14:52.016188 27581 tablet_bootstrap.cc:654] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:52.016368 27580 tablet_bootstrap.cc:654] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:52.016408 27585 tablet_bootstrap.cc:492] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: No bootstrap required, opened a new log
I20260928 20:14:52.016462 27585 ts_tablet_manager.cc:1397] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:52.016629 27585 raft_consensus.cc:348] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.016687 27585 raft_consensus.cc:374] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:52.016722 27585 raft_consensus.cc:729] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c68cbf7449ba483fa59267818f94442b, State: Initialized, Role: FOLLOWER
I20260928 20:14:52.016782 27585 consensus_queue.cc:260] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.016898 27585 ts_tablet_manager.cc:1428] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:52.016963 27581 tablet_bootstrap.cc:492] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: No bootstrap required, opened a new log
I20260928 20:14:52.017012 27581 ts_tablet_manager.cc:1397] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:52.017040 27588 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.017123 27588 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:52.017153 27581 raft_consensus.cc:348] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.017215 27581 raft_consensus.cc:374] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:52.017233 27581 raft_consensus.cc:729] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Initialized, Role: FOLLOWER
I20260928 20:14:52.017277 27581 consensus_queue.cc:260] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.017383 27581 ts_tablet_manager.cc:1428] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:52.017470 27586 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.017570 27586 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:52.017712 27580 tablet_bootstrap.cc:492] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: No bootstrap required, opened a new log
I20260928 20:14:52.017768 27580 ts_tablet_manager.cc:1397] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:14:52.017936 27580 raft_consensus.cc:348] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.018046 27580 raft_consensus.cc:374] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:52.018072 27580 raft_consensus.cc:729] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Initialized, Role: FOLLOWER
I20260928 20:14:52.018126 27580 consensus_queue.cc:260] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.018216 27580 ts_tablet_manager.cc:1428] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:52.018287 27584 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.018395 27584 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: This TxnStatusTablet replica's current role is: FOLLOWER
W20260928 20:14:52.020030 27558 tablet.cc:2369] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:14:52.063686 27586 raft_consensus.cc:482] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:52.063820 27586 raft_consensus.cc:504] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.064224 27586 leader_election.cc:288] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:52.067277 27310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.064444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37865 (local address 127.24.190.2:33245)
0928 20:14:52.064509 (+ 65us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:52.064523 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:52.064587 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:52.064776 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:52.064777 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:52.064779 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:52.064902 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.064905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.065665 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.065666 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.066507 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.066510 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.067037 (+ 527us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.067038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.067129 (+ 91us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.067133 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:14:52.067186 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:14:52.067224 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42,"mutex_wait_us":40}
I20260928 20:14:52.067355 27579 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.064528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33245 (local address 127.24.190.1:37865)
0928 20:14:52.064594 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.064596 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.064625 (+ 29us) server_negotiation.cc:407] Connection header received
0928 20:14:52.064653 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.064654 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.064700 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.064757 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:52.064982 (+ 225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.065577 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.066590 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.066959 (+ 369us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.067014 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.067020 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.067225 (+ 205us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.067268 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:14:52.067487 27576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.064630 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:56591 (local address 127.24.190.3:41969)
0928 20:14:52.064678 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.064680 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.064839 (+ 159us) server_negotiation.cc:407] Connection header received
0928 20:14:52.064868 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.064869 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.064879 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.064948 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:52.065120 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.065599 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.066646 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.067046 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.067121 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.067128 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.067364 (+ 236us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.067407 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:14:52.067497 27601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.064561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:41969 (local address 127.24.190.2:56591)
0928 20:14:52.064757 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:52.064768 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:52.064822 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:52.064975 (+ 153us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:52.064976 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:52.064977 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:52.065048 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.065050 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.065715 (+ 665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.065716 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.066536 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.066538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.067161 (+ 623us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.067162 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.067266 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.067270 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:14:52.067334 (+ 64us) client_negotiation.cc:240] Negotiation successful
0928 20:14:52.067412 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":125,"threads_started":1}
I20260928 20:14:52.067605 27231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff63ae893974ebfbd9373343cb5907f" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b" is_pre_election: true
I20260928 20:14:52.067716 27231 raft_consensus.cc:2454] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 0.
I20260928 20:14:52.067914 27305 leader_election.cc:302] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12b9fe5292ac4939a56922076197cb31, c68cbf7449ba483fa59267818f94442b; no voters:
I20260928 20:14:52.067934 27511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff63ae893974ebfbd9373343cb5907f" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f851db96f7f44c34a40d8b6d299938e3" is_pre_election: true
I20260928 20:14:52.068044 27586 raft_consensus.cc:2781] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:52.068077 27586 raft_consensus.cc:482] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:52.068064 27511 raft_consensus.cc:2454] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 0.
I20260928 20:14:52.068104 27586 raft_consensus.cc:3037] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:52.068794 27586 raft_consensus.cc:504] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.068928 27586 leader_election.cc:288] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 election: Requested vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:52.069087 27231 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff63ae893974ebfbd9373343cb5907f" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b"
I20260928 20:14:52.069092 27511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3ff63ae893974ebfbd9373343cb5907f" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f851db96f7f44c34a40d8b6d299938e3"
I20260928 20:14:52.069160 27511 raft_consensus.cc:3037] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:52.069160 27231 raft_consensus.cc:3037] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:52.069878 27231 raft_consensus.cc:2454] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 1.
I20260928 20:14:52.069974 27511 raft_consensus.cc:2454] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 1.
I20260928 20:14:52.070081 27305 leader_election.cc:302] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12b9fe5292ac4939a56922076197cb31, c68cbf7449ba483fa59267818f94442b; no voters:
I20260928 20:14:52.070218 27586 raft_consensus.cc:2781] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:52.070423 27586 raft_consensus.cc:686] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [term 1 LEADER]: Becoming Leader. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Running, Role: LEADER
I20260928 20:14:52.070544 27586 consensus_queue.cc:237] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.070964 27602 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: TxnStatusTablet state changed. Reason: New leader 12b9fe5292ac4939a56922076197cb31. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.071051 27602 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:14:52.071295 27604 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260928 20:14:52.071422 27604 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260928 20:14:52.071439 27074 catalog_manager.cc:5495] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12b9fe5292ac4939a56922076197cb31 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260928 20:14:52.077150 27597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.074435 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.0.0.1:48138)
0928 20:14:52.074498 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:52.074509 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:52.074575 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:52.074748 (+ 173us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:52.074748 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:52.074749 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:52.074791 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.074793 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.075658 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.075658 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.076239 (+ 581us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.076241 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.076698 (+ 457us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.076698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.076744 (+ 46us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.076757 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.077024 (+ 267us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.077030 (+ 6us) client_negotiation.cc:769] Sending connection context
0928 20:14:52.077059 (+ 29us) client_negotiation.cc:240] Negotiation successful
0928 20:14:52.077096 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260928 20:14:52.077183 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.074551 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48138 (local address 127.24.190.2:43543)
0928 20:14:52.074610 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.074612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.074635 (+ 23us) server_negotiation.cc:407] Connection header received
0928 20:14:52.074662 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.074663 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.074680 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.074746 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:52.074835 (+ 89us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.075575 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.076319 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.076621 (+ 302us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.076694 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.076843 (+ 149us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.076957 (+ 114us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.077040 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.077064 (+ 24us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.077088 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:14:52.079061 27231 raft_consensus.cc:1261] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Refusing update from remote peer 12b9fe5292ac4939a56922076197cb31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:52.079061 27511 raft_consensus.cc:1261] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Refusing update from remote peer 12b9fe5292ac4939a56922076197cb31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:52.079394 27586 consensus_queue.cc:1035] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:52.079514 27602 consensus_queue.cc:1035] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:52.080629 27584 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: TxnStatusTablet state changed. Reason: New leader 12b9fe5292ac4939a56922076197cb31. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.080729 27584 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:52.080814 27588 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: TxnStatusTablet state changed. Reason: New leader 12b9fe5292ac4939a56922076197cb31. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.080893 27588 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:52.081864 27602 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.081940 27602 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:14:52.081981 27588 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.082051 27588 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P c68cbf7449ba483fa59267818f94442b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:52.082185 27607 mvcc.cc:205] Tried to move back new op lower bound from 7334406111552901120 to 7334406111521423360. Current Snapshot: MvccSnapshot[applied={T|T < 7334406111552901120 or (T in {7334406111552901120})}]
I20260928 20:14:52.083565 27586 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.083653 27586 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P 12b9fe5292ac4939a56922076197cb31: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:14:52.084074 27584 tablet_replica.cc:439] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } } }
I20260928 20:14:52.084165 27584 tablet_replica.cc:442] T 3ff63ae893974ebfbd9373343cb5907f P f851db96f7f44c34a40d8b6d299938e3: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:14:52.085080 27609 mvcc.cc:205] Tried to move back new op lower bound from 7334406111552901120 to 7334406111521423360. Current Snapshot: MvccSnapshot[applied={T|T < 7334406111552901120 or (T in {7334406111552901120})}]
I20260928 20:14:52.086680 27576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.083637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60646 (local address 127.24.190.3:41969)
0928 20:14:52.083895 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.083897 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.083907 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:14:52.083935 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.083936 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.083953 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.084014 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:52.084491 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.084943 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.085897 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.086097 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.086178 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.086378 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.086475 (+ 97us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.086564 (+ 89us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.086586 (+ 22us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.086607 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":239}
I20260928 20:14:52.091635 27563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.088806 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.24.190.3:35549)
0928 20:14:52.088874 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:52.088908 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:52.088957 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:52.089103 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:52.089104 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:52.089106 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:52.089161 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.089162 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.090046 (+ 884us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.090047 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.090816 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.090818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.091268 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.091269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.091314 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.091326 (+ 12us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.091521 (+ 195us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.091523 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:14:52.091556 (+ 33us) client_negotiation.cc:240] Negotiation successful
0928 20:14:52.091587 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":19}
I20260928 20:14:52.091647 27577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.088877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:35549 (local address 127.24.190.2:43543)
0928 20:14:52.088932 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.088934 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.088942 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:52.089007 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.089008 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.089018 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.089090 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:52.089233 (+ 143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.089976 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.090887 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.091191 (+ 304us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.091257 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.091432 (+ 175us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.091463 (+ 31us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.091516 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.091559 (+ 43us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.091578 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 20:14:52.094049 27231 raft_consensus.cc:1261] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Refusing update from remote peer f851db96f7f44c34a40d8b6d299938e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:52.094144 27371 raft_consensus.cc:1261] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Refusing update from remote peer f851db96f7f44c34a40d8b6d299938e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:52.094389 27584 consensus_queue.cc:1035] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:52.094494 27590 consensus_queue.cc:1035] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:52.102481 27423 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.099929 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:41969 (local address 127.24.190.2:42209)
0928 20:14:52.100024 (+ 95us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:52.100034 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:52.100078 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:52.100217 (+ 139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:52.100218 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:52.100220 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:52.100282 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.100283 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.100962 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.100963 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.101545 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:52.101547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.101994 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.101995 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:52.102060 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.102075 (+ 15us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.102305 (+ 230us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.102307 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:14:52.102353 (+ 46us) client_negotiation.cc:240] Negotiation successful
0928 20:14:52.102401 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61}
I20260928 20:14:52.102676 27576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:52.099963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:42209 (local address 127.24.190.3:41969)
0928 20:14:52.100002 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:52.100004 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:52.100067 (+ 63us) server_negotiation.cc:407] Connection header received
0928 20:14:52.100149 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:52.100150 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:52.100160 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:52.100216 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:52.100369 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.100882 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.101645 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:52.101882 (+ 237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:52.101940 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:52.102188 (+ 248us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:52.102223 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:52.102287 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:52.102581 (+ 294us) server_negotiation.cc:299] Negotiation successful
0928 20:14:52.102604 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:14:52.112627 27073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:52.112772 27073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:52.113543 27073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Sending DeleteTablet for 3 replicas of tablet fc191c3473964627b8897c1986413ea4
I20260928 20:14:52.113835 27491 tablet_service.cc:1514] Processing DeleteTablet for tablet fc191c3473964627b8897c1986413ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:52 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:60634
I20260928 20:14:52.113996 27211 tablet_service.cc:1514] Processing DeleteTablet for tablet fc191c3473964627b8897c1986413ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:52 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48086
I20260928 20:14:52.114185 27625 tablet_replica.cc:330] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: stopping tablet replica
I20260928 20:14:52.114233 27349 tablet_service.cc:1514] Processing DeleteTablet for tablet fc191c3473964627b8897c1986413ea4 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:52 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48126
I20260928 20:14:52.114390 27625 raft_consensus.cc:2229] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:14:52.114521 27625 raft_consensus.cc:2258] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:52.114791 27073 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53262:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:14:52.114946 27073 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:52.115120 27625 ts_tablet_manager.cc:1905] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:52.116112 27491 tablet_service.cc:1467] Processing CreateTablet for tablet ad47c55320604829a94b26ad09b5713c (DEFAULT_TABLE table=test-table [id=47d24927ff2b428ba66302e5692b4e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:52.116307 27491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad47c55320604829a94b26ad09b5713c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:52.116339 27349 tablet_service.cc:1467] Processing CreateTablet for tablet ad47c55320604829a94b26ad09b5713c (DEFAULT_TABLE table=test-table [id=47d24927ff2b428ba66302e5692b4e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:52.116446 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad47c55320604829a94b26ad09b5713c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:52.117481 27580 tablet_bootstrap.cc:492] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Bootstrap starting.
I20260928 20:14:52.117890 27580 tablet_bootstrap.cc:654] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:52.118213 27581 tablet_bootstrap.cc:492] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Bootstrap starting.
I20260928 20:14:52.118296 27211 tablet_service.cc:1467] Processing CreateTablet for tablet ad47c55320604829a94b26ad09b5713c (DEFAULT_TABLE table=test-table [id=47d24927ff2b428ba66302e5692b4e82]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:52.118414 27211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad47c55320604829a94b26ad09b5713c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:52.118633 27581 tablet_bootstrap.cc:654] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:52.118826 27625 ts_tablet_manager.cc:1918] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:52.118940 27625 log.cc:1196] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/fc191c3473964627b8897c1986413ea4
I20260928 20:14:52.119262 27625 ts_tablet_manager.cc:1939] T fc191c3473964627b8897c1986413ea4 P f851db96f7f44c34a40d8b6d299938e3: Deleting consensus metadata
I20260928 20:14:52.119690 27061 catalog_manager.cc:4841] TS f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969): tablet fc191c3473964627b8897c1986413ea4 (table test-table [id=74c6a71444ef4190acf8eb13a874690f]) successfully deleted
I20260928 20:14:52.119778 27585 tablet_bootstrap.cc:492] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Bootstrap starting.
I20260928 20:14:52.120432 27585 tablet_bootstrap.cc:654] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:52.121114 27585 tablet_bootstrap.cc:492] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: No bootstrap required, opened a new log
I20260928 20:14:52.121160 27585 ts_tablet_manager.cc:1397] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:52.121296 27585 raft_consensus.cc:348] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.121416 27585 raft_consensus.cc:374] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:52.121445 27585 raft_consensus.cc:729] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c68cbf7449ba483fa59267818f94442b, State: Initialized, Role: FOLLOWER
I20260928 20:14:52.121487 27585 consensus_queue.cc:260] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.121582 27585 ts_tablet_manager.cc:1428] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:52.121858 27627 tablet_replica.cc:330] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: stopping tablet replica
I20260928 20:14:52.121973 27627 raft_consensus.cc:2229] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:52.122033 27627 raft_consensus.cc:2258] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:52.121294 27626 tablet_replica.cc:330] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: stopping tablet replica
I20260928 20:14:52.122534 27627 ts_tablet_manager.cc:1905] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:52.122887 27626 raft_consensus.cc:2229] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:52.122975 27626 raft_consensus.cc:2258] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:52.123399 27626 ts_tablet_manager.cc:1905] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:52.124217 27627 ts_tablet_manager.cc:1918] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:52.124334 27627 log.cc:1196] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/fc191c3473964627b8897c1986413ea4
I20260928 20:14:52.124635 27627 ts_tablet_manager.cc:1939] T fc191c3473964627b8897c1986413ea4 P 12b9fe5292ac4939a56922076197cb31: Deleting consensus metadata
I20260928 20:14:52.125036 27060 catalog_manager.cc:4841] TS 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543): tablet fc191c3473964627b8897c1986413ea4 (table test-table [id=74c6a71444ef4190acf8eb13a874690f]) successfully deleted
I20260928 20:14:52.125164 27626 ts_tablet_manager.cc:1918] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:52.125232 27626 log.cc:1196] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/fc191c3473964627b8897c1986413ea4
I20260928 20:14:52.125473 27626 ts_tablet_manager.cc:1939] T fc191c3473964627b8897c1986413ea4 P c68cbf7449ba483fa59267818f94442b: Deleting consensus metadata
I20260928 20:14:52.125890 27061 catalog_manager.cc:4841] TS c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865): tablet fc191c3473964627b8897c1986413ea4 (table test-table [id=74c6a71444ef4190acf8eb13a874690f]) successfully deleted
I20260928 20:14:52.126665 27580 tablet_bootstrap.cc:492] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: No bootstrap required, opened a new log
I20260928 20:14:52.126739 27580 ts_tablet_manager.cc:1397] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260928 20:14:52.126883 27580 raft_consensus.cc:348] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.126951 27580 raft_consensus.cc:374] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:52.126971 27580 raft_consensus.cc:729] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Initialized, Role: FOLLOWER
I20260928 20:14:52.127017 27580 consensus_queue.cc:260] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.127095 27580 ts_tablet_manager.cc:1428] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:52.127306 27581 tablet_bootstrap.cc:492] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: No bootstrap required, opened a new log
I20260928 20:14:52.127359 27581 ts_tablet_manager.cc:1397] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.000s
I20260928 20:14:52.127491 27581 raft_consensus.cc:348] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.127566 27581 raft_consensus.cc:374] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:52.127588 27581 raft_consensus.cc:729] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Initialized, Role: FOLLOWER
I20260928 20:14:52.127632 27581 consensus_queue.cc:260] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.127717 27581 ts_tablet_manager.cc:1428] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:52.297155 27584 raft_consensus.cc:482] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:52.297253 27584 raft_consensus.cc:504] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.297420 27584 leader_election.cc:288] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543)
I20260928 20:14:52.297742 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad47c55320604829a94b26ad09b5713c" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b" is_pre_election: true
I20260928 20:14:52.297761 27371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad47c55320604829a94b26ad09b5713c" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b9fe5292ac4939a56922076197cb31" is_pre_election: true
I20260928 20:14:52.297863 27371 raft_consensus.cc:2454] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 0.
I20260928 20:14:52.297868 27230 raft_consensus.cc:2454] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 0.
I20260928 20:14:52.298041 27445 leader_election.cc:302] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c68cbf7449ba483fa59267818f94442b, f851db96f7f44c34a40d8b6d299938e3; no voters:
I20260928 20:14:52.298141 27584 raft_consensus.cc:2781] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:52.298177 27584 raft_consensus.cc:482] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:52.298195 27584 raft_consensus.cc:3037] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:52.298898 27584 raft_consensus.cc:504] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.299029 27584 leader_election.cc:288] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 election: Requested vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543)
I20260928 20:14:52.299166 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad47c55320604829a94b26ad09b5713c" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b"
I20260928 20:14:52.299173 27371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad47c55320604829a94b26ad09b5713c" candidate_uuid: "f851db96f7f44c34a40d8b6d299938e3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b9fe5292ac4939a56922076197cb31"
I20260928 20:14:52.299237 27230 raft_consensus.cc:3037] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:52.299237 27371 raft_consensus.cc:3037] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:52.300010 27371 raft_consensus.cc:2454] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 1.
I20260928 20:14:52.300010 27230 raft_consensus.cc:2454] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f851db96f7f44c34a40d8b6d299938e3 in term 1.
I20260928 20:14:52.300215 27444 leader_election.cc:302] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12b9fe5292ac4939a56922076197cb31, f851db96f7f44c34a40d8b6d299938e3; no voters:
I20260928 20:14:52.300318 27584 raft_consensus.cc:2781] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:52.300369 27584 raft_consensus.cc:686] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 1 LEADER]: Becoming Leader. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Running, Role: LEADER
I20260928 20:14:52.300423 27584 consensus_queue.cc:237] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:52.301079 27074 catalog_manager.cc:5495] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 reported cstate change: term changed from 0 to 1, leader changed from <none> to f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3). New cstate: current_term: 1 leader_uuid: "f851db96f7f44c34a40d8b6d299938e3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } health_report { overall_health: HEALTHY } } }
I20260928 20:14:52.307343 27371 raft_consensus.cc:1261] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Refusing update from remote peer f851db96f7f44c34a40d8b6d299938e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:52.307451 27230 raft_consensus.cc:1261] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Refusing update from remote peer f851db96f7f44c34a40d8b6d299938e3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:52.307567 27584 consensus_queue.cc:1035] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:52.307698 27584 consensus_queue.cc:1035] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:52.308772 27608 mvcc.cc:205] Tried to move back new op lower bound from 7334406112489713664 to 7334406112463114240. Current Snapshot: MvccSnapshot[applied={T|T < 7334406112489713664}]
W20260928 20:14:52.312029 27609 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260928 20:14:53.833662 27074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:53.833774 27074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53262:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:53.834580 27074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Sending DeleteTablet for 3 replicas of tablet ad47c55320604829a94b26ad09b5713c
I20260928 20:14:53.834828 27211 tablet_service.cc:1514] Processing DeleteTablet for tablet ad47c55320604829a94b26ad09b5713c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:53 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48086
I20260928 20:14:53.834828 27349 tablet_service.cc:1514] Processing DeleteTablet for tablet ad47c55320604829a94b26ad09b5713c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:53 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48126
I20260928 20:14:53.834834 27491 tablet_service.cc:1514] Processing DeleteTablet for tablet ad47c55320604829a94b26ad09b5713c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:53 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:60634
I20260928 20:14:53.835027 27656 tablet_replica.cc:330] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: stopping tablet replica
I20260928 20:14:53.835104 27656 raft_consensus.cc:2229] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:53.835158 27656 raft_consensus.cc:2258] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:53.835250 27657 tablet_replica.cc:330] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: stopping tablet replica
I20260928 20:14:53.835309 27657 raft_consensus.cc:2229] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:53.835361 27657 raft_consensus.cc:2258] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:53.835602 27657 ts_tablet_manager.cc:1905] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:53.835598 27656 ts_tablet_manager.cc:1905] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:53.837144 27658 tablet_replica.cc:330] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: stopping tablet replica
I20260928 20:14:53.837246 27658 raft_consensus.cc:2229] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:14:53.837312 27658 raft_consensus.cc:2258] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:53.837527 27656 ts_tablet_manager.cc:1918] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 20:14:53.837541 27657 ts_tablet_manager.cc:1918] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 20:14:53.837574 27656 log.cc:1196] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/ad47c55320604829a94b26ad09b5713c
I20260928 20:14:53.837604 27657 log.cc:1196] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/ad47c55320604829a94b26ad09b5713c
I20260928 20:14:53.837846 27657 ts_tablet_manager.cc:1939] T ad47c55320604829a94b26ad09b5713c P 12b9fe5292ac4939a56922076197cb31: Deleting consensus metadata
I20260928 20:14:53.837893 27656 ts_tablet_manager.cc:1939] T ad47c55320604829a94b26ad09b5713c P c68cbf7449ba483fa59267818f94442b: Deleting consensus metadata
I20260928 20:14:53.838197 27061 catalog_manager.cc:4841] TS c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865): tablet ad47c55320604829a94b26ad09b5713c (table test-table [id=47d24927ff2b428ba66302e5692b4e82]) successfully deleted
I20260928 20:14:53.838212 27060 catalog_manager.cc:4841] TS 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543): tablet ad47c55320604829a94b26ad09b5713c (table test-table [id=47d24927ff2b428ba66302e5692b4e82]) successfully deleted
I20260928 20:14:53.838231 27658 ts_tablet_manager.cc:1905] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:53.840061 27658 ts_tablet_manager.cc:1918] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 20:14:53.840126 27658 log.cc:1196] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/ad47c55320604829a94b26ad09b5713c
I20260928 20:14:53.840406 27658 ts_tablet_manager.cc:1939] T ad47c55320604829a94b26ad09b5713c P f851db96f7f44c34a40d8b6d299938e3: Deleting consensus metadata
I20260928 20:14:53.840833 27061 catalog_manager.cc:4841] TS f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969): tablet ad47c55320604829a94b26ad09b5713c (table test-table [id=47d24927ff2b428ba66302e5692b4e82]) successfully deleted
Sep 28 20:14:53 dist-test-slave-n45k krb5kdc[27029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626493, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 28 20:14:53 dist-test-slave-n45k krb5kdc[27029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626493, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:53.859057 27666 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.851803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53278 (local address 127.24.190.62:39469)
0928 20:14:53.851958 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:53.851960 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:53.851988 (+ 28us) server_negotiation.cc:407] Connection header received
0928 20:14:53.852013 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:53.852014 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:53.852024 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:53.852076 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:53.852641 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.853163 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.853940 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.854187 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.854256 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:53.856553 (+ 2297us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:53.856554 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:53.856555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:53.856561 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:53.858002 (+ 1441us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:53.858388 (+ 386us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:53.858389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:53.858390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:53.858452 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:53.858657 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:53.858657 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:53.858657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:53.858758 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:53.858835 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:53.858923 (+ 88us) server_negotiation.cc:299] Negotiation successful
0928 20:14:53.858986 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":103,"threads_started":1}
I20260928 20:14:53.860688 27074 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:14:53.860859 27074 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:53.862253 27491 tablet_service.cc:1467] Processing CreateTablet for tablet 60f37ad7826d4f709f9e0be9becd0580 (DEFAULT_TABLE table=test-table [id=da8c4290ee5a4534a4ff645bb309016a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:53.862226 27211 tablet_service.cc:1467] Processing CreateTablet for tablet 60f37ad7826d4f709f9e0be9becd0580 (DEFAULT_TABLE table=test-table [id=da8c4290ee5a4534a4ff645bb309016a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:53.862378 27349 tablet_service.cc:1467] Processing CreateTablet for tablet 60f37ad7826d4f709f9e0be9becd0580 (DEFAULT_TABLE table=test-table [id=da8c4290ee5a4534a4ff645bb309016a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:53.862416 27491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60f37ad7826d4f709f9e0be9becd0580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:53.862437 27211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60f37ad7826d4f709f9e0be9becd0580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:53.862483 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 60f37ad7826d4f709f9e0be9becd0580. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:53.863385 27667 tablet_bootstrap.cc:492] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Bootstrap starting.
I20260928 20:14:53.863747 27667 tablet_bootstrap.cc:654] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:53.863843 27668 tablet_bootstrap.cc:492] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Bootstrap starting.
I20260928 20:14:53.864183 27668 tablet_bootstrap.cc:654] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:53.864262 27670 tablet_bootstrap.cc:492] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Bootstrap starting.
I20260928 20:14:53.864459 27667 tablet_bootstrap.cc:492] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: No bootstrap required, opened a new log
I20260928 20:14:53.864514 27667 ts_tablet_manager.cc:1397] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:53.864640 27670 tablet_bootstrap.cc:654] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:53.864620 27667 raft_consensus.cc:348] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.864693 27667 raft_consensus.cc:374] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:53.864730 27667 raft_consensus.cc:729] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Initialized, Role: FOLLOWER
I20260928 20:14:53.864843 27668 tablet_bootstrap.cc:492] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: No bootstrap required, opened a new log
I20260928 20:14:53.864871 27667 consensus_queue.cc:260] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.864912 27668 ts_tablet_manager.cc:1397] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:53.865003 27667 ts_tablet_manager.cc:1428] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:53.865209 27670 tablet_bootstrap.cc:492] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: No bootstrap required, opened a new log
I20260928 20:14:53.865178 27668 raft_consensus.cc:348] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.865264 27668 raft_consensus.cc:374] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:53.865259 27670 ts_tablet_manager.cc:1397] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:53.865293 27668 raft_consensus.cc:729] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c68cbf7449ba483fa59267818f94442b, State: Initialized, Role: FOLLOWER
I20260928 20:14:53.865365 27668 consensus_queue.cc:260] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.865377 27670 raft_consensus.cc:348] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.865448 27670 raft_consensus.cc:374] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:53.865491 27670 raft_consensus.cc:729] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Initialized, Role: FOLLOWER
I20260928 20:14:53.865556 27668 ts_tablet_manager.cc:1428] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 20:14:53.865551 27670 consensus_queue.cc:260] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.865650 27670 ts_tablet_manager.cc:1428] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:53.943897 27637 raft_consensus.cc:482] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:53.943987 27637 raft_consensus.cc:504] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.944125 27637 leader_election.cc:288] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:53.944389 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f37ad7826d4f709f9e0be9becd0580" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b" is_pre_election: true
I20260928 20:14:53.944401 27511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f37ad7826d4f709f9e0be9becd0580" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f851db96f7f44c34a40d8b6d299938e3" is_pre_election: true
I20260928 20:14:53.944510 27230 raft_consensus.cc:2454] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 0.
I20260928 20:14:53.944507 27511 raft_consensus.cc:2454] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 0.
I20260928 20:14:53.944681 27305 leader_election.cc:302] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12b9fe5292ac4939a56922076197cb31, c68cbf7449ba483fa59267818f94442b; no voters:
I20260928 20:14:53.944780 27637 raft_consensus.cc:2781] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:53.944828 27637 raft_consensus.cc:482] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:53.944856 27637 raft_consensus.cc:3037] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:53.945591 27637 raft_consensus.cc:504] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.945732 27637 leader_election.cc:288] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 election: Requested vote from peers c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865), f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:53.945914 27230 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f37ad7826d4f709f9e0be9becd0580" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c68cbf7449ba483fa59267818f94442b"
I20260928 20:14:53.945932 27511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "60f37ad7826d4f709f9e0be9becd0580" candidate_uuid: "12b9fe5292ac4939a56922076197cb31" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f851db96f7f44c34a40d8b6d299938e3"
I20260928 20:14:53.946000 27511 raft_consensus.cc:3037] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:53.946002 27230 raft_consensus.cc:3037] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:53.946805 27511 raft_consensus.cc:2454] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 1.
I20260928 20:14:53.946856 27230 raft_consensus.cc:2454] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 12b9fe5292ac4939a56922076197cb31 in term 1.
I20260928 20:14:53.947033 27305 leader_election.cc:302] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12b9fe5292ac4939a56922076197cb31, f851db96f7f44c34a40d8b6d299938e3; no voters:
I20260928 20:14:53.947135 27637 raft_consensus.cc:2781] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:53.947201 27637 raft_consensus.cc:686] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 1 LEADER]: Becoming Leader. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Running, Role: LEADER
I20260928 20:14:53.947247 27637 consensus_queue.cc:237] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.947912 27073 catalog_manager.cc:5495] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 reported cstate change: term changed from 0 to 1, leader changed from <none> to 12b9fe5292ac4939a56922076197cb31 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "12b9fe5292ac4939a56922076197cb31" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260928 20:14:53.960907 27676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.958652 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48152 (local address 127.24.190.2:43543)
0928 20:14:53.958818 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:53.958820 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:53.958828 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:53.958901 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:53.958902 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:53.958912 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:53.958966 (+ 54us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:53.959049 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.959518 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.960311 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.960505 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.960569 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:53.960671 (+ 102us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:53.960696 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:53.960727 (+ 31us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:53.960765 (+ 38us) server_negotiation.cc:299] Negotiation successful
0928 20:14:53.960781 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260928 20:14:53.965272 27676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.962971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:37671 (local address 127.24.190.2:43543)
0928 20:14:53.963037 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:53.963039 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:53.963102 (+ 63us) server_negotiation.cc:407] Connection header received
0928 20:14:53.963163 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:53.963164 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:53.963174 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:53.963226 (+ 52us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:53.963338 (+ 112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.963782 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.964586 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.964771 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.964852 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:53.964995 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:53.965029 (+ 34us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:53.965088 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:53.965147 (+ 59us) server_negotiation.cc:299] Negotiation successful
0928 20:14:53.965165 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 20:14:53.965281 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.962902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.24.190.2:37671)
0928 20:14:53.963050 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:53.963061 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:53.963117 (+ 56us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:53.963229 (+ 112us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:53.963230 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:53.963231 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:53.963272 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:53.963274 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.963871 (+ 597us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.963872 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:53.964487 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:53.964489 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.964852 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.964852 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:53.964914 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:53.964918 (+ 4us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:53.965088 (+ 170us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:53.965089 (+ 1us) client_negotiation.cc:769] Sending connection context
0928 20:14:53.965142 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:14:53.965185 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":94,"threads_started":1}
I20260928 20:14:53.967408 27230 raft_consensus.cc:1261] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Refusing update from remote peer 12b9fe5292ac4939a56922076197cb31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:53.967425 27511 raft_consensus.cc:1261] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Refusing update from remote peer 12b9fe5292ac4939a56922076197cb31: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:53.967617 27602 consensus_queue.cc:1035] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:53.967752 27637 consensus_queue.cc:1035] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:53.978592 27073 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:53.978703 27073 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:53.979426 27073 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Sending DeleteTablet for 3 replicas of tablet 60f37ad7826d4f709f9e0be9becd0580
I20260928 20:14:53.979660 27211 tablet_service.cc:1514] Processing DeleteTablet for tablet 60f37ad7826d4f709f9e0be9becd0580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:53 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48086
I20260928 20:14:53.979686 27491 tablet_service.cc:1514] Processing DeleteTablet for tablet 60f37ad7826d4f709f9e0be9becd0580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:53 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:60634
I20260928 20:14:53.979786 27656 tablet_replica.cc:330] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: stopping tablet replica
I20260928 20:14:53.979835 27656 raft_consensus.cc:2229] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:53.979841 27349 tablet_service.cc:1514] Processing DeleteTablet for tablet 60f37ad7826d4f709f9e0be9becd0580 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:53 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48126
I20260928 20:14:53.979873 27656 raft_consensus.cc:2258] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:53.979940 27658 tablet_replica.cc:330] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: stopping tablet replica
I20260928 20:14:53.979964 27657 tablet_replica.cc:330] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: stopping tablet replica
I20260928 20:14:53.980002 27658 raft_consensus.cc:2229] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:53.980015 27657 raft_consensus.cc:2229] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:14:53.980041 27658 raft_consensus.cc:2258] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:53.980094 27657 raft_consensus.cc:2258] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:53.980515 27658 ts_tablet_manager.cc:1905] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:53.980542 27656 ts_tablet_manager.cc:1905] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:53.981688 27073 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53278:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:14:53.981875 27073 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:14:53.982155 27657 ts_tablet_manager.cc:1905] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:53.982183 27656 ts_tablet_manager.cc:1918] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:53.982235 27656 log.cc:1196] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/60f37ad7826d4f709f9e0be9becd0580
I20260928 20:14:53.982506 27656 ts_tablet_manager.cc:1939] T 60f37ad7826d4f709f9e0be9becd0580 P c68cbf7449ba483fa59267818f94442b: Deleting consensus metadata
I20260928 20:14:53.982785 27658 ts_tablet_manager.cc:1918] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:53.982837 27658 log.cc:1196] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/60f37ad7826d4f709f9e0be9becd0580
I20260928 20:14:53.982888 27061 catalog_manager.cc:4841] TS c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865): tablet 60f37ad7826d4f709f9e0be9becd0580 (table test-table [id=da8c4290ee5a4534a4ff645bb309016a]) successfully deleted
I20260928 20:14:53.983054 27658 ts_tablet_manager.cc:1939] T 60f37ad7826d4f709f9e0be9becd0580 P f851db96f7f44c34a40d8b6d299938e3: Deleting consensus metadata
I20260928 20:14:53.983361 27061 catalog_manager.cc:4841] TS f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969): tablet 60f37ad7826d4f709f9e0be9becd0580 (table test-table [id=da8c4290ee5a4534a4ff645bb309016a]) successfully deleted
I20260928 20:14:53.983850 27657 ts_tablet_manager.cc:1918] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:14:53.983927 27657 log.cc:1196] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/60f37ad7826d4f709f9e0be9becd0580
I20260928 20:14:53.984124 27657 ts_tablet_manager.cc:1939] T 60f37ad7826d4f709f9e0be9becd0580 P 12b9fe5292ac4939a56922076197cb31: Deleting consensus metadata
I20260928 20:14:53.984596 27060 catalog_manager.cc:4841] TS 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543): tablet 60f37ad7826d4f709f9e0be9becd0580 (table test-table [id=da8c4290ee5a4534a4ff645bb309016a]) successfully deleted
I20260928 20:14:53.985284 27491 tablet_service.cc:1467] Processing CreateTablet for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 (DEFAULT_TABLE table=test-table [id=47de66096e764d9593d1353faad91dce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:53.985275 27349 tablet_service.cc:1467] Processing CreateTablet for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 (DEFAULT_TABLE table=test-table [id=47de66096e764d9593d1353faad91dce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:53.985381 27349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:53.985381 27491 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:53.986438 27211 tablet_service.cc:1467] Processing CreateTablet for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 (DEFAULT_TABLE table=test-table [id=47de66096e764d9593d1353faad91dce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:14:53.986534 27211 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:53.986575 27667 tablet_bootstrap.cc:492] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Bootstrap starting.
I20260928 20:14:53.986881 27667 tablet_bootstrap.cc:654] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:53.987130 27670 tablet_bootstrap.cc:492] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Bootstrap starting.
I20260928 20:14:53.987406 27670 tablet_bootstrap.cc:654] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:53.987685 27668 tablet_bootstrap.cc:492] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b: Bootstrap starting.
I20260928 20:14:53.987900 27667 tablet_bootstrap.cc:492] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: No bootstrap required, opened a new log
I20260928 20:14:53.987959 27667 ts_tablet_manager.cc:1397] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:53.988116 27667 raft_consensus.cc:348] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.988201 27667 raft_consensus.cc:374] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:53.988229 27667 raft_consensus.cc:729] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f851db96f7f44c34a40d8b6d299938e3, State: Initialized, Role: FOLLOWER
I20260928 20:14:53.988258 27668 tablet_bootstrap.cc:654] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:53.988282 27667 consensus_queue.cc:260] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.988399 27667 ts_tablet_manager.cc:1428] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:53.988871 27668 tablet_bootstrap.cc:492] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b: No bootstrap required, opened a new log
I20260928 20:14:53.988926 27668 ts_tablet_manager.cc:1397] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:14:53.988938 27670 tablet_bootstrap.cc:492] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: No bootstrap required, opened a new log
I20260928 20:14:53.988988 27670 ts_tablet_manager.cc:1397] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.000s
I20260928 20:14:53.989069 27668 raft_consensus.cc:348] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.989136 27668 raft_consensus.cc:374] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:53.989113 27670 raft_consensus.cc:348] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.989163 27668 raft_consensus.cc:729] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c68cbf7449ba483fa59267818f94442b, State: Initialized, Role: FOLLOWER
I20260928 20:14:53.989176 27670 raft_consensus.cc:374] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:53.989205 27670 raft_consensus.cc:729] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b9fe5292ac4939a56922076197cb31, State: Initialized, Role: FOLLOWER
I20260928 20:14:53.989200 27668 consensus_queue.cc:260] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.989250 27670 consensus_queue.cc:260] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.989276 27668 ts_tablet_manager.cc:1428] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:53.989341 27670 ts_tablet_manager.cc:1428] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:53.996433 27673 raft_consensus.cc:482] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:14:53.996529 27673 raft_consensus.cc:504] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:53.996934 27673 leader_election.cc:288] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543), f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:54.000504 27687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.997104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:41969 (local address 127.24.190.1:42541)
0928 20:14:53.997238 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:53.997250 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:53.997303 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:53.997698 (+ 395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:53.997699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:53.997702 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:53.997770 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:53.997772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.998754 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.998754 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:53.999549 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:53.999551 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.000226 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.000227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.000301 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.000306 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:14:54.000352 (+ 46us) client_negotiation.cc:240] Negotiation successful
0928 20:14:54.000401 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":85,"threads_started":1}
I20260928 20:14:54.000790 27689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.997395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:42541 (local address 127.24.190.3:41969)
0928 20:14:53.997520 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:53.997522 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:53.997530 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:53.997570 (+ 40us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:53.997571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:53.997581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:53.997647 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:53.997836 (+ 189us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.998679 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.999657 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.000045 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.000178 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.000190 (+ 12us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:54.000679 (+ 489us) server_negotiation.cc:299] Negotiation successful
0928 20:14:54.000722 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":53,"threads_started":1}
I20260928 20:14:54.000969 27511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c840fdabaf7e46cd9b43f5a8b97ff6b9" candidate_uuid: "c68cbf7449ba483fa59267818f94442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f851db96f7f44c34a40d8b6d299938e3" is_pre_election: true
I20260928 20:14:54.001051 27511 raft_consensus.cc:2454] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c68cbf7449ba483fa59267818f94442b in term 0.
I20260928 20:14:54.001245 27165 leader_election.cc:302] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c68cbf7449ba483fa59267818f94442b, f851db96f7f44c34a40d8b6d299938e3; no voters:
I20260928 20:14:54.001372 27673 raft_consensus.cc:2781] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:14:54.001408 27673 raft_consensus.cc:482] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:14:54.001430 27673 raft_consensus.cc:3037] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:54.001686 27688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.997052 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.24.190.1:38841)
0928 20:14:53.997237 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:53.997249 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:53.997304 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:53.998530 (+ 1226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:53.998531 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:53.998533 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:14:53.998601 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:53.998602 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.999515 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:53.999516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.000698 (+ 1182us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:54.000700 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.001432 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.001433 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.001509 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.001514 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:14:54.001576 (+ 62us) client_negotiation.cc:240] Negotiation successful
0928 20:14:54.001616 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":69,"threads_started":1}
I20260928 20:14:54.001693 27676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:53.997305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:38841 (local address 127.24.190.2:43543)
0928 20:14:53.998379 (+ 1074us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:53.998381 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:53.998390 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:14:53.998413 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:53.998414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:53.998422 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:53.998478 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:14:53.998673 (+ 195us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:53.999409 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.000794 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.001361 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.001433 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.001441 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:54.001590 (+ 149us) server_negotiation.cc:299] Negotiation successful
0928 20:14:54.001627 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:14:54.001878 27371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c840fdabaf7e46cd9b43f5a8b97ff6b9" candidate_uuid: "c68cbf7449ba483fa59267818f94442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b9fe5292ac4939a56922076197cb31" is_pre_election: true
I20260928 20:14:54.001946 27371 raft_consensus.cc:2454] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c68cbf7449ba483fa59267818f94442b in term 0.
I20260928 20:14:54.002454 27673 raft_consensus.cc:504] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:54.002596 27673 leader_election.cc:288] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [CANDIDATE]: Term 1 election: Requested vote from peers 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543), f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969)
I20260928 20:14:54.002717 27371 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c840fdabaf7e46cd9b43f5a8b97ff6b9" candidate_uuid: "c68cbf7449ba483fa59267818f94442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "12b9fe5292ac4939a56922076197cb31"
I20260928 20:14:54.002728 27511 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c840fdabaf7e46cd9b43f5a8b97ff6b9" candidate_uuid: "c68cbf7449ba483fa59267818f94442b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f851db96f7f44c34a40d8b6d299938e3"
I20260928 20:14:54.002780 27371 raft_consensus.cc:3037] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:54.002794 27511 raft_consensus.cc:3037] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:54.003297 27371 raft_consensus.cc:2454] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c68cbf7449ba483fa59267818f94442b in term 1.
I20260928 20:14:54.003472 27164 leader_election.cc:302] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 12b9fe5292ac4939a56922076197cb31, c68cbf7449ba483fa59267818f94442b; no voters:
I20260928 20:14:54.003549 27511 raft_consensus.cc:2454] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c68cbf7449ba483fa59267818f94442b in term 1.
I20260928 20:14:54.003566 27673 raft_consensus.cc:2781] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:54.003716 27673 raft_consensus.cc:686] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [term 1 LEADER]: Becoming Leader. State: Replica: c68cbf7449ba483fa59267818f94442b, State: Running, Role: LEADER
I20260928 20:14:54.003779 27673 consensus_queue.cc:237] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } }
I20260928 20:14:54.004534 27073 catalog_manager.cc:5495] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b reported cstate change: term changed from 0 to 1, leader changed from <none> to c68cbf7449ba483fa59267818f94442b (127.24.190.1). New cstate: current_term: 1 leader_uuid: "c68cbf7449ba483fa59267818f94442b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c68cbf7449ba483fa59267818f94442b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37865 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 } health_report { overall_health: UNKNOWN } } }
I20260928 20:14:54.016062 27692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:54.013227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48100 (local address 127.24.190.1:37865)
0928 20:14:54.013410 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:54.013412 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:54.013421 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:14:54.013467 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:54.013468 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:54.013491 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:54.013585 (+ 94us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:54.013667 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.014451 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.015200 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.015525 (+ 325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.015597 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.015709 (+ 112us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:54.015849 (+ 140us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:54.015919 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:54.015949 (+ 30us) server_negotiation.cc:299] Negotiation successful
0928 20:14:54.015967 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":161,"thread_start_us":106,"threads_started":1}
I20260928 20:14:54.021260 27676 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:54.018751 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:45159 (local address 127.24.190.2:43543)
0928 20:14:54.018796 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:54.018798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:54.018806 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:54.018880 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:54.018881 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:54.018892 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:54.018945 (+ 53us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:54.019096 (+ 151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.019735 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.020514 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.020713 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.020798 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.021010 (+ 212us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:54.021047 (+ 37us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:54.021108 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:54.021160 (+ 52us) server_negotiation.cc:299] Negotiation successful
0928 20:14:54.021181 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:14:54.021309 27695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:54.018520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43543 (local address 127.24.190.1:45159)
0928 20:14:54.018743 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:54.018755 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:54.018815 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:54.018956 (+ 141us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:54.018957 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:54.018959 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:54.019015 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:54.019016 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.019825 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.019825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.020426 (+ 601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:54.020427 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.020812 (+ 385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.020814 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.020902 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.020916 (+ 14us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:54.021108 (+ 192us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:54.021110 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:14:54.021157 (+ 47us) client_negotiation.cc:240] Negotiation successful
0928 20:14:54.021200 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":78,"threads_started":1}
I20260928 20:14:54.023578 27511 raft_consensus.cc:1261] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Refusing update from remote peer c68cbf7449ba483fa59267818f94442b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:54.023578 27371 raft_consensus.cc:1261] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Refusing update from remote peer c68cbf7449ba483fa59267818f94442b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:14:54.023852 27673 consensus_queue.cc:1035] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f851db96f7f44c34a40d8b6d299938e3" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:54.024014 27690 consensus_queue.cc:1035] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P c68cbf7449ba483fa59267818f94442b [LEADER]: Connected to new peer: Peer: permanent_uuid: "12b9fe5292ac4939a56922076197cb31" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:14:54.031819 27679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:54.028959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37865 (local address 127.24.190.2:40999)
0928 20:14:54.029019 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:54.029030 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:54.029072 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:54.029310 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:54.029311 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:54.029312 (+ 1us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:14:54.029359 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:54.029360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.030233 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.030234 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.031007 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:54.031010 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.031482 (+ 472us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.031483 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:54.031525 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.031530 (+ 5us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:14:54.031680 (+ 150us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:14:54.031681 (+ 1us) client_negotiation.cc:769] Sending connection context
0928 20:14:54.031711 (+ 30us) client_negotiation.cc:240] Negotiation successful
0928 20:14:54.031746 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260928 20:14:54.031826 27692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:54.029144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:40999 (local address 127.24.190.1:37865)
0928 20:14:54.029204 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:54.029207 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:54.029215 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:14:54.029236 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:54.029237 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:54.029247 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:54.029293 (+ 46us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:14:54.029425 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.030145 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.031093 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:54.031409 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:54.031480 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:54.031596 (+ 116us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:14:54.031628 (+ 32us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:14:54.031681 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:54.031714 (+ 33us) server_negotiation.cc:299] Negotiation successful
0928 20:14:54.031734 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
W20260928 20:14:54.032439 27640 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260928 20:14:55.555704 27074 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:55.555830 27074 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:53278:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:14:55.556718 27074 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64f41f11828247f08b70a7436bbc3469: Sending DeleteTablet for 3 replicas of tablet c840fdabaf7e46cd9b43f5a8b97ff6b9
I20260928 20:14:55.556963 27211 tablet_service.cc:1514] Processing DeleteTablet for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:55 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48086
I20260928 20:14:55.557011 27349 tablet_service.cc:1514] Processing DeleteTablet for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:55 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48126
I20260928 20:14:55.557065 27491 tablet_service.cc:1514] Processing DeleteTablet for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:14:55 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:60634
I20260928 20:14:55.557204 27722 tablet_replica.cc:330] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: stopping tablet replica
I20260928 20:14:55.557255 27723 tablet_replica.cc:330] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: stopping tablet replica
I20260928 20:14:55.557313 27723 raft_consensus.cc:2229] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:55.557312 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27146
I20260928 20:14:55.557353 27723 raft_consensus.cc:2258] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:55.558416 27723 ts_tablet_manager.cc:1905] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:14:55.560103 27723 ts_tablet_manager.cc:1918] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 20:14:55.560173 27723 log.cc:1196] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/c840fdabaf7e46cd9b43f5a8b97ff6b9
I20260928 20:14:55.560412 27723 ts_tablet_manager.cc:1939] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P f851db96f7f44c34a40d8b6d299938e3: Deleting consensus metadata
I20260928 20:14:55.560765 27061 catalog_manager.cc:4841] TS f851db96f7f44c34a40d8b6d299938e3 (127.24.190.3:41969): tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 (table test-table [id=47de66096e764d9593d1353faad91dce]) successfully deleted
I20260928 20:14:55.557256 27722 raft_consensus.cc:2229] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:14:55.563019 27722 raft_consensus.cc:2258] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:14:55.563259 27722 ts_tablet_manager.cc:1905] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Deleting tablet data with delete state TABLET_DATA_DELETED
W20260928 20:14:55.564584 27061 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:37865 (error 108)
I20260928 20:14:55.564780 27722 ts_tablet_manager.cc:1918] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260928 20:14:55.564850 27722 log.cc:1196] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/c840fdabaf7e46cd9b43f5a8b97ff6b9
I20260928 20:14:55.565061 27722 ts_tablet_manager.cc:1939] T c840fdabaf7e46cd9b43f5a8b97ff6b9 P 12b9fe5292ac4939a56922076197cb31: Deleting consensus metadata
W20260928 20:14:55.565451 27725 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:14:55.565003 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37865 (local address 127.0.0.1:57160)
0928 20:14:55.565146 (+ 143us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:55.565160 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:55.565217 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:55.565369 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:37865: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":92,"threads_started":1}
W20260928 20:14:55.565584 27061 catalog_manager.cc:4584] TS c68cbf7449ba483fa59267818f94442b (127.24.190.1:37865): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c840fdabaf7e46cd9b43f5a8b97ff6b9: Network error: Client connection negotiation failed: client connection to 127.24.190.1:37865: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 20:14:55.565681 27060 catalog_manager.cc:4841] TS 12b9fe5292ac4939a56922076197cb31 (127.24.190.2:43543): tablet c840fdabaf7e46cd9b43f5a8b97ff6b9 (table test-table [id=47de66096e764d9593d1353faad91dce]) successfully deleted
I20260928 20:14:55.565917 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27286
I20260928 20:14:55.573192 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27426
I20260928 20:14:55.578774 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27042
2026-09-28T20:14:55Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (5644 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:55 dist-test-slave-n45k krb5kdc[27728](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:55 dist-test-slave-n45k krb5kdc[27728](info): set up 2 sockets
Sep 28 20:14:55 dist-test-slave-n45k krb5kdc[27728](info): commencing operation
krb5kdc: starting...
W20260928 20:14:56.630574 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.030s user 0.005s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:56 dist-test-slave-n45k krb5kdc[27728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:56.750741 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39117
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:39117
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:56.832271 27741 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:56.832522 27741 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:56.832557 27741 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:56.833711 27741 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:14:56.833784 27741 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:56.833808 27741 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:56.833835 27741 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:14:56.833865 27741 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:14:56.835341 27741 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:39117
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39117
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27741
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:56.835610 27741 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:56.835834 27741 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:56.840668 27747 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:56.840705 27749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:56.840817 27741 server_base.cc:1034] running on GCE node
W20260928 20:14:56.840667 27746 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:56.841208 27741 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:56.841526 27741 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:56.842680 27741 hybrid_clock.cc:648] HybridClock initialized: now 1790626496842666 us; error 50 us; skew 500 ppm
Sep 28 20:14:56 dist-test-slave-n45k krb5kdc[27728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626496, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:56.849020 27741 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:14:56.849473 27741 webserver.cc:460] Webserver started at http://127.24.190.62:45135/ using document root <none> and password file <none>
I20260928 20:14:56.849713 27741 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:56.849782 27741 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:56.849947 27741 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:56.851078 27741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "ab8ef1e002834a27bf046e128164a775"
format_stamp: "Formatted at 2026-09-28 20:14:56 on dist-test-slave-n45k"
server_key: "c45893796b1634da540b8b2b133ec1c5"
server_key_iv: "e054c27c4d196e12d5e70a8439786551"
server_key_version: "encryptionkey@0"
I20260928 20:14:56.851435 27741 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "ab8ef1e002834a27bf046e128164a775"
format_stamp: "Formatted at 2026-09-28 20:14:56 on dist-test-slave-n45k"
server_key: "c45893796b1634da540b8b2b133ec1c5"
server_key_iv: "e054c27c4d196e12d5e70a8439786551"
server_key_version: "encryptionkey@0"
I20260928 20:14:56.852778 27741 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:14:56.853540 27756 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:56.853708 27741 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:14:56.853799 27741 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "ab8ef1e002834a27bf046e128164a775"
format_stamp: "Formatted at 2026-09-28 20:14:56 on dist-test-slave-n45k"
server_key: "c45893796b1634da540b8b2b133ec1c5"
server_key_iv: "e054c27c4d196e12d5e70a8439786551"
server_key_version: "encryptionkey@0"
I20260928 20:14:56.853915 27741 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:56.871812 27741 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:56.873725 27741 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:56.873898 27741 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:56.877707 27741 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:39117
I20260928 20:14:56.877763 27808 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:39117 every 8 connection(s)
I20260928 20:14:56.878125 27741 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:14:56.879045 27809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:56.881223 27809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775: Bootstrap starting.
I20260928 20:14:56.881767 27809 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:56.882005 27809 log.cc:824] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:56.882707 27809 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775: No bootstrap required, opened a new log
I20260928 20:14:56.884287 27809 raft_consensus.cc:348] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8ef1e002834a27bf046e128164a775" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39117 } }
I20260928 20:14:56.884424 27809 raft_consensus.cc:374] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:56.884446 27809 raft_consensus.cc:729] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab8ef1e002834a27bf046e128164a775, State: Initialized, Role: FOLLOWER
I20260928 20:14:56.884582 27809 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8ef1e002834a27bf046e128164a775" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39117 } }
I20260928 20:14:56.884665 27809 raft_consensus.cc:388] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:14:56.884687 27809 raft_consensus.cc:482] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:14:56.884716 27809 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:56.885190 27809 raft_consensus.cc:504] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8ef1e002834a27bf046e128164a775" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39117 } }
I20260928 20:14:56.885270 27809 leader_election.cc:302] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ab8ef1e002834a27bf046e128164a775; no voters:
I20260928 20:14:56.885469 27809 leader_election.cc:288] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:14:56.885496 27812 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:56.885483 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27741
I20260928 20:14:56.885584 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:14:56.885622 27812 raft_consensus.cc:686] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [term 1 LEADER]: Becoming Leader. State: Replica: ab8ef1e002834a27bf046e128164a775, State: Running, Role: LEADER
I20260928 20:14:56.885730 27809 sys_catalog.cc:564] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:14:56.885757 25336 external_mini_cluster.cc:1428] Setting key ee72b953413c1ef07e21a1013914ebef
I20260928 20:14:56.885766 27812 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8ef1e002834a27bf046e128164a775" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39117 } }
I20260928 20:14:56.886083 27812 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab8ef1e002834a27bf046e128164a775. Latest consensus state: current_term: 1 leader_uuid: "ab8ef1e002834a27bf046e128164a775" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8ef1e002834a27bf046e128164a775" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39117 } } }
I20260928 20:14:56.886231 27812 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:56.886293 27814 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ab8ef1e002834a27bf046e128164a775" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ab8ef1e002834a27bf046e128164a775" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39117 } } }
I20260928 20:14:56.886446 27814 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775 [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:56.886548 27821 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:14:56.887074 27821 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:14:56.891009 27821 catalog_manager.cc:1347] Generated new cluster ID: 63f18612343b458f805c50cc445e13f1
I20260928 20:14:56.891062 27821 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:14:56 dist-test-slave-n45k krb5kdc[27728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626496, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:56.897737 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:56.886397 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34922 (local address 127.24.190.62:39117)
0928 20:14:56.886974 (+ 577us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:56.886983 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:56.887021 (+ 38us) server_negotiation.cc:407] Connection header received
0928 20:14:56.887148 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:56.887156 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:56.887232 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:56.887405 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:56.888169 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:56.889572 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:56.890309 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:56.890924 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:56.891032 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:56.894004 (+ 2972us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:56.894008 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:56.894008 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:56.894021 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:56.896022 (+ 2001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:56.896443 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:56.896446 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:56.896447 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:56.896574 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:56.896788 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:56.896789 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:56.896789 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:56.897102 (+ 313us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:56.897246 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:56.897389 (+ 143us) server_negotiation.cc:299] Negotiation successful
0928 20:14:56.897524 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":521,"thread_start_us":81,"threads_started":1}
I20260928 20:14:56.898676 27821 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:14:56.899359 27821 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:14:56.911324 27821 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ab8ef1e002834a27bf046e128164a775: Generated new TSK 0
I20260928 20:14:56.911520 27821 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:14:56.941763 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39117
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:57.023782 27835 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:57.024029 27835 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:57.024067 27835 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:57.025236 27835 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:57.025305 27835 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:57.025360 27835 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:14:57.026839 27835 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27835
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:57.027109 27835 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:57.027347 27835 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:57.032773 27841 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:57.032747 27843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:57.032760 27840 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:57.032819 27835 server_base.cc:1034] running on GCE node
I20260928 20:14:57.033165 27835 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:57.033425 27835 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:57.034571 27835 hybrid_clock.cc:648] HybridClock initialized: now 1790626497034559 us; error 28 us; skew 500 ppm
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[27728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626497, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:57.037119 27835 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:14:57.037563 27835 webserver.cc:460] Webserver started at http://127.24.190.1:39795/ using document root <none> and password file <none>
I20260928 20:14:57.037802 27835 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:57.037858 27835 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:57.037989 27835 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:57.039106 27835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "cb6b10e03de0497dbf4cceca15232093"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "575fc2d016484fee46890773d09fb0aa"
server_key_iv: "8d05c2a41aed93fe3576366068022f02"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.039464 27835 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "cb6b10e03de0497dbf4cceca15232093"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "575fc2d016484fee46890773d09fb0aa"
server_key_iv: "8d05c2a41aed93fe3576366068022f02"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.040841 27835 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:14:57.041653 27850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.041885 27835 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:14:57.041990 27835 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "cb6b10e03de0497dbf4cceca15232093"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "575fc2d016484fee46890773d09fb0aa"
server_key_iv: "8d05c2a41aed93fe3576366068022f02"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.042073 27835 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:57.059314 27835 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:57.061803 27835 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:57.061996 27835 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:57.062251 27835 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:57.062636 27835 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:57.062700 27835 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.062737 27835 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:57.062763 27835 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.068976 27835 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:40115
I20260928 20:14:57.069028 27963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:40115 every 8 connection(s)
I20260928 20:14:57.069346 27835 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[27728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626497, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:57.077150 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27835
I20260928 20:14:57.077291 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:14:57.077481 25336 external_mini_cluster.cc:1428] Setting key 7d75e8fa3c6265c46ca32d59fab59a80
I20260928 20:14:57.079237 27966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:57.070069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39117 (local address 127.24.190.1:55435)
0928 20:14:57.070340 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:57.070378 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:57.070947 (+ 569us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:57.071179 (+ 232us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:57.071183 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:57.071750 (+ 567us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:57.071943 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:57.071947 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.072610 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.072611 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:57.073518 (+ 907us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:57.073521 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.073853 (+ 332us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.073853 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:57.073947 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:57.074533 (+ 586us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:57.074541 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:57.075945 (+ 1404us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:57.077739 (+ 1794us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:57.077745 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:57.077747 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:57.078056 (+ 309us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:57.078263 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:57.078264 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:57.078265 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:57.078418 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:57.078736 (+ 318us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:57.078740 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:57.078877 (+ 137us) client_negotiation.cc:769] Sending connection context
0928 20:14:57.078955 (+ 78us) client_negotiation.cc:240] Negotiation successful
0928 20:14:57.079078 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":231,"thread_start_us":105,"threads_started":1}
I20260928 20:14:57.079260 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:57.070088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:55435 (local address 127.24.190.62:39117)
0928 20:14:57.070156 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:57.070159 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:57.070456 (+ 297us) server_negotiation.cc:407] Connection header received
0928 20:14:57.071053 (+ 597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:57.071053 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:57.071063 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:57.071121 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:57.072028 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.072533 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.073598 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.073784 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.073834 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:57.076034 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:57.076035 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:57.076035 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:57.076042 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:57.077641 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:57.078127 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:57.078128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:57.078128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:57.078187 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:57.078514 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:57.078515 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:57.078516 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:57.078668 (+ 152us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:57.078743 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:57.079016 (+ 273us) server_negotiation.cc:299] Negotiation successful
0928 20:14:57.079120 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 20:14:57.080160 27964 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39117
I20260928 20:14:57.080273 27964 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:57.080508 27964 heartbeater.cc:511] Master 127.24.190.62:39117 requested a full tablet report, sending...
I20260928 20:14:57.081055 27773 ts_manager.cc:194] Registered new tserver with Master: cb6b10e03de0497dbf4cceca15232093 (127.24.190.1:40115)
I20260928 20:14:57.082005 27773 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:55435
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:14:57.105175 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39117
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:57.185997 27969 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:57.186196 27969 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:57.186219 27969 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:57.187568 27969 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:57.187630 27969 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:57.187678 27969 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:14:57.189129 27969 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.27969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:57.189404 27969 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:57.189633 27969 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:57.194566 27975 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:57.194589 27969 server_base.cc:1034] running on GCE node
W20260928 20:14:57.194573 27974 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:57.194566 27977 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:57.195041 27969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:57.195297 27969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:57.196470 27969 hybrid_clock.cc:648] HybridClock initialized: now 1790626497196465 us; error 35 us; skew 500 ppm
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[27728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626497, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:57.198861 27969 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:14:57.199318 27969 webserver.cc:460] Webserver started at http://127.24.190.2:44303/ using document root <none> and password file <none>
I20260928 20:14:57.199559 27969 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:57.199626 27969 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:57.199775 27969 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:57.200793 27969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "d2b478cda7854df788ac18734f264309"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "4adfce49b065c46c9e2b081a84e1c1cd"
server_key_iv: "149c80f22a6c4ea9c29f0efd9eaaf0b9"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.201143 27969 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "d2b478cda7854df788ac18734f264309"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "4adfce49b065c46c9e2b081a84e1c1cd"
server_key_iv: "149c80f22a6c4ea9c29f0efd9eaaf0b9"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.202450 27969 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:14:57.203174 27984 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.203369 27969 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:57.203465 27969 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "d2b478cda7854df788ac18734f264309"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "4adfce49b065c46c9e2b081a84e1c1cd"
server_key_iv: "149c80f22a6c4ea9c29f0efd9eaaf0b9"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.203549 27969 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:57.210433 27969 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:57.212119 27969 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:57.212282 27969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:57.212503 27969 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:57.212798 27969 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:57.212859 27969 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.212898 27969 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:57.212924 27969 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.218777 27969 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:37091
I20260928 20:14:57.218828 28097 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:37091 every 8 connection(s)
I20260928 20:14:57.219154 27969 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:14:57.220963 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 27969
I20260928 20:14:57.221083 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:14:57.221297 25336 external_mini_cluster.cc:1428] Setting key 60f5e4639a4fee46b4012230aecbebe7
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[27728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626497, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
I20260928 20:14:57.230062 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:57.219949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:41229 (local address 127.24.190.62:39117)
0928 20:14:57.220018 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:57.220020 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:57.220277 (+ 257us) server_negotiation.cc:407] Connection header received
0928 20:14:57.220736 (+ 459us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:57.220737 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:57.220747 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:57.220842 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:57.222140 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.222710 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.224002 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.224323 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.224412 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:57.226966 (+ 2554us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:57.226968 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:57.226968 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:57.226976 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:57.228606 (+ 1630us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:57.229048 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:57.229049 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:57.229050 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:57.229111 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:57.229361 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:57.229362 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:57.229363 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:57.229480 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:57.229556 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:57.229867 (+ 311us) server_negotiation.cc:299] Negotiation successful
0928 20:14:57.229963 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 20:14:57.230257 28100 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:57.219942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39117 (local address 127.24.190.2:41229)
0928 20:14:57.220183 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:57.220217 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:57.220656 (+ 439us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:57.220959 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:57.220965 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:57.221777 (+ 812us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:57.222025 (+ 248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:57.222049 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.222798 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.222799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:57.223894 (+ 1095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:57.223896 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.224461 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.224462 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:57.224609 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:57.225150 (+ 541us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:57.225160 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:57.226864 (+ 1704us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:57.228722 (+ 1858us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:57.228730 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:57.228733 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:57.228968 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:57.229182 (+ 214us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:57.229183 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:57.229183 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:57.229291 (+ 108us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:57.229547 (+ 256us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:57.229553 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:57.229697 (+ 144us) client_negotiation.cc:769] Sending connection context
0928 20:14:57.229860 (+ 163us) client_negotiation.cc:240] Negotiation successful
0928 20:14:57.230026 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":208,"thread_start_us":186,"threads_started":1}
I20260928 20:14:57.230752 28098 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39117
I20260928 20:14:57.230854 28098 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:57.230995 28098 heartbeater.cc:511] Master 127.24.190.62:39117 requested a full tablet report, sending...
I20260928 20:14:57.231326 27773 ts_manager.cc:194] Registered new tserver with Master: d2b478cda7854df788ac18734f264309 (127.24.190.2:37091)
I20260928 20:14:57.231668 27773 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:41229
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:14:57.249691 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39117
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39333
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:57.331789 28103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:57.332047 28103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:57.332087 28103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:57.333269 28103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:57.333355 28103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:57.333403 28103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:14:57.334901 28103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39333
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39117
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28103
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:57.335209 28103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:57.335471 28103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:57.340669 28109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:57.340880 28103 server_base.cc:1034] running on GCE node
W20260928 20:14:57.340677 28108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:57.340682 28111 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:57.341430 28103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:57.341711 28103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:57.342854 28103 hybrid_clock.cc:648] HybridClock initialized: now 1790626497342824 us; error 38 us; skew 500 ppm
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[27728](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626497, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:57.345624 28103 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:14:57.346129 28103 webserver.cc:460] Webserver started at http://127.24.190.3:43815/ using document root <none> and password file <none>
I20260928 20:14:57.346441 28103 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:57.346509 28103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:57.346649 28103 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:57.347719 28103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "df30e9a7ba7d4718b5f81b06ea0a72cd"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "3a3825f1f633da4c2982e12fdbeb7be4"
server_key_iv: "a6c751d4105ef63f36227eac00825ce7"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.348093 28103 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "df30e9a7ba7d4718b5f81b06ea0a72cd"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "3a3825f1f633da4c2982e12fdbeb7be4"
server_key_iv: "a6c751d4105ef63f36227eac00825ce7"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.349483 28103 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:14:57.350214 28118 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.350420 28103 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:14:57.350514 28103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "df30e9a7ba7d4718b5f81b06ea0a72cd"
format_stamp: "Formatted at 2026-09-28 20:14:57 on dist-test-slave-n45k"
server_key: "3a3825f1f633da4c2982e12fdbeb7be4"
server_key_iv: "a6c751d4105ef63f36227eac00825ce7"
server_key_version: "encryptionkey@0"
I20260928 20:14:57.350605 28103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:57.373239 28103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:57.375867 28103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:57.376044 28103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:57.376295 28103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:14:57.376631 28103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:14:57.376686 28103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.376727 28103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:14:57.376755 28103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:57.382543 28103 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:41861
I20260928 20:14:57.382632 28231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:41861 every 8 connection(s)
I20260928 20:14:57.382925 28103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:14:57.384828 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28103
I20260928 20:14:57.384960 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:14:57.385130 25336 external_mini_cluster.cc:1428] Setting key 10120fdbdc19f06603a8cb05f1c151ce
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[27728](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626497, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:57.392831 27823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:57.383651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:52037 (local address 127.24.190.62:39117)
0928 20:14:57.383725 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:57.383726 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:57.383957 (+ 231us) server_negotiation.cc:407] Connection header received
0928 20:14:57.384482 (+ 525us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:57.384483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:57.384517 (+ 34us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:57.384570 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:57.385880 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.386535 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.387624 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.387836 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.387919 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:57.390254 (+ 2335us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:57.390255 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:57.390256 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:57.390262 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:57.391695 (+ 1433us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:57.392079 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:57.392079 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:57.392080 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:57.392129 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:57.392338 (+ 209us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:57.392338 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:57.392338 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:57.392438 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:57.392487 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:57.392710 (+ 223us) server_negotiation.cc:299] Negotiation successful
0928 20:14:57.392769 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:14:57.393023 28234 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:57.383652 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39117 (local address 127.24.190.3:52037)
0928 20:14:57.383832 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0928 20:14:57.383873 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:14:57.384376 (+ 503us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:14:57.384656 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:14:57.384659 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:14:57.385338 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:14:57.385644 (+ 306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:57.385650 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.386636 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.386638 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:57.387532 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:14:57.387535 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:14:57.387924 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:14:57.387925 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:14:57.388054 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:57.388614 (+ 560us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:14:57.388623 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:14:57.390161 (+ 1538us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:14:57.391782 (+ 1621us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:57.391787 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:57.391789 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:57.392012 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:57.392186 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:14:57.392187 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:14:57.392187 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:14:57.392284 (+ 97us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:14:57.392491 (+ 207us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:14:57.392494 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:14:57.392604 (+ 110us) client_negotiation.cc:769] Sending connection context
0928 20:14:57.392684 (+ 80us) client_negotiation.cc:240] Negotiation successful
0928 20:14:57.392796 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":87,"threads_started":1}
I20260928 20:14:57.393455 28232 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39117
I20260928 20:14:57.393540 28232 heartbeater.cc:464] Registering TS with master...
I20260928 20:14:57.393671 28232 heartbeater.cc:511] Master 127.24.190.62:39117 requested a full tablet report, sending...
I20260928 20:14:57.394011 27773 ts_manager.cc:194] Registered new tserver with Master: df30e9a7ba7d4718b5f81b06ea0a72cd (127.24.190.3:41861)
I20260928 20:14:57.394430 27773 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:52037
I20260928 20:14:57.396731 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260928 20:14:57.407968 27823 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:14:57.407007 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34938 (local address 127.24.190.62:39117)
0928 20:14:57.407070 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:57.407072 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:57.407247 (+ 175us) server_negotiation.cc:407] Connection header received
0928 20:14:57.407283 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:57.407284 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:57.407294 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:57.407371 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:57.407891 (+ 520us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:34938: BlockingRecv error: recv got EOF from 127.0.0.1:34938 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 20:14:57.408875 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27835
I20260928 20:14:57.413420 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27969
I20260928 20:14:57.417290 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28103
I20260928 20:14:57.421464 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 27741
2026-09-28T20:14:57Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (1841 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[28244](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[28244](info): set up 2 sockets
Sep 28 20:14:57 dist-test-slave-n45k krb5kdc[28244](info): commencing operation
krb5kdc: starting...
W20260928 20:14:58.474606 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.033s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:58 dist-test-slave-n45k krb5kdc[28244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:58.593780 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35893
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39651
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:35893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:14:58.673328 28257 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:14:58.673584 28257 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:14:58.673622 28257 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:14:58.674893 28257 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:14:58.674954 28257 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:14:58.674978 28257 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:14:58.675009 28257 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:14:58.675038 28257 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:14:58.676548 28257 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39651
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:35893
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28257
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:14:58.676822 28257 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:14:58.677054 28257 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:14:58.682004 28265 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:58.682014 28262 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:14:58.682014 28263 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:14:58.682132 28257 server_base.cc:1034] running on GCE node
I20260928 20:14:58.682473 28257 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:14:58.682732 28257 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:14:58.683887 28257 hybrid_clock.cc:648] HybridClock initialized: now 1790626498683866 us; error 46 us; skew 500 ppm
Sep 28 20:14:58 dist-test-slave-n45k krb5kdc[28244](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626498, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:14:58.686682 28257 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:14:58.687129 28257 webserver.cc:460] Webserver started at http://127.24.190.62:35841/ using document root <none> and password file <none>
I20260928 20:14:58.687316 28257 fs_manager.cc:359] Metadata directory not provided
I20260928 20:14:58.687366 28257 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:14:58.687457 28257 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:14:58.688545 28257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "a8676ed10ebd44699451fcdde852f8bf"
format_stamp: "Formatted at 2026-09-28 20:14:58 on dist-test-slave-n45k"
server_key: "428c014693f2afb801473dcd0c9eed74"
server_key_iv: "067637d76626df88bfbd91db1f351534"
server_key_version: "encryptionkey@0"
I20260928 20:14:58.688843 28257 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "a8676ed10ebd44699451fcdde852f8bf"
format_stamp: "Formatted at 2026-09-28 20:14:58 on dist-test-slave-n45k"
server_key: "428c014693f2afb801473dcd0c9eed74"
server_key_iv: "067637d76626df88bfbd91db1f351534"
server_key_version: "encryptionkey@0"
I20260928 20:14:58.690141 28257 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:14:58.690929 28272 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:58.691102 28257 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:14:58.691187 28257 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "a8676ed10ebd44699451fcdde852f8bf"
format_stamp: "Formatted at 2026-09-28 20:14:58 on dist-test-slave-n45k"
server_key: "428c014693f2afb801473dcd0c9eed74"
server_key_iv: "067637d76626df88bfbd91db1f351534"
server_key_version: "encryptionkey@0"
I20260928 20:14:58.691242 28257 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:14:58.704645 28257 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:14:58.706926 28257 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:14:58.707038 28257 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:14:58.710758 28257 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:35893
I20260928 20:14:58.710829 28324 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:35893 every 8 connection(s)
I20260928 20:14:58.711295 28257 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:14:58.712203 28325 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:14:58.714643 28325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf: Bootstrap starting.
I20260928 20:14:58.715235 28325 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf: Neither blocks nor log segments found. Creating new log.
I20260928 20:14:58.715533 28325 log.cc:824] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf: Log is configured to *not* fsync() on all Append() calls
I20260928 20:14:58.716239 28325 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf: No bootstrap required, opened a new log
I20260928 20:14:58.717849 28325 raft_consensus.cc:348] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8676ed10ebd44699451fcdde852f8bf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35893 } }
I20260928 20:14:58.718015 28325 raft_consensus.cc:374] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:14:58.718063 28325 raft_consensus.cc:729] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8676ed10ebd44699451fcdde852f8bf, State: Initialized, Role: FOLLOWER
I20260928 20:14:58.718235 28325 consensus_queue.cc:260] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8676ed10ebd44699451fcdde852f8bf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35893 } }
I20260928 20:14:58.718351 28325 raft_consensus.cc:388] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:14:58.718391 28325 raft_consensus.cc:482] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:14:58.718438 28325 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:14:58.718451 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28257
I20260928 20:14:58.718536 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:14:58.718750 25336 external_mini_cluster.cc:1428] Setting key 68a62b6cb9d885922b6d17e726b4c75e
I20260928 20:14:58.719759 28325 raft_consensus.cc:504] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8676ed10ebd44699451fcdde852f8bf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35893 } }
I20260928 20:14:58.719880 28325 leader_election.cc:302] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8676ed10ebd44699451fcdde852f8bf; no voters:
I20260928 20:14:58.720054 28325 leader_election.cc:288] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:14:58.720121 28330 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:14:58.720253 28330 raft_consensus.cc:686] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [term 1 LEADER]: Becoming Leader. State: Replica: a8676ed10ebd44699451fcdde852f8bf, State: Running, Role: LEADER
I20260928 20:14:58.720345 28325 sys_catalog.cc:564] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:14:58.720345 28330 consensus_queue.cc:237] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8676ed10ebd44699451fcdde852f8bf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35893 } }
I20260928 20:14:58.720715 28330 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a8676ed10ebd44699451fcdde852f8bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8676ed10ebd44699451fcdde852f8bf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35893 } } }
I20260928 20:14:58.720790 28330 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:58.720925 28330 sys_catalog.cc:455] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [sys.catalog]: SysCatalogTable state changed. Reason: New leader a8676ed10ebd44699451fcdde852f8bf. Latest consensus state: current_term: 1 leader_uuid: "a8676ed10ebd44699451fcdde852f8bf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8676ed10ebd44699451fcdde852f8bf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35893 } } }
I20260928 20:14:58.720984 28330 sys_catalog.cc:458] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf [sys.catalog]: This master's current role is: LEADER
I20260928 20:14:58.721092 28337 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:14:58.722005 28337 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:14:58.723461 28337 catalog_manager.cc:1347] Generated new cluster ID: 655212f470234628bc7ad3dc25b6851d
I20260928 20:14:58.723511 28337 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:14:58 dist-test-slave-n45k krb5kdc[28244](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626498, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:14:58.731331 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:58.719220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34916 (local address 127.24.190.62:35893)
0928 20:14:58.719439 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:58.719447 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:58.719472 (+ 25us) server_negotiation.cc:407] Connection header received
0928 20:14:58.719561 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:58.719567 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:58.719607 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:58.719712 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:58.720561 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:58.722536 (+ 1975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:58.723611 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:58.724211 (+ 600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:58.724322 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:58.727146 (+ 2824us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:58.727150 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:58.727151 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:14:58.727163 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:58.729602 (+ 2439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:58.730042 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:58.730044 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:58.730045 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:58.730153 (+ 108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:14:58.730397 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:14:58.730398 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:14:58.730398 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:14:58.730696 (+ 298us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:58.730853 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:58.730988 (+ 135us) server_negotiation.cc:299] Negotiation successful
0928 20:14:58.731117 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":166,"thread_start_us":101,"threads_started":1}
I20260928 20:14:58.732404 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:14:58.741931 28337 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:14:58.742524 28337 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:14:58.748257 28337 catalog_manager.cc:5868] T 00000000000000000000000000000000 P a8676ed10ebd44699451fcdde852f8bf: Generated new TSK 0
I20260928 20:14:58.748440 28337 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:14:58.750377 28329 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:14:58.744838 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34918 (local address 127.24.190.62:35893)
0928 20:14:58.746346 (+ 1508us) server_negotiation.cc:206] Beginning negotiation
0928 20:14:58.746348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:14:58.746355 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:14:58.746381 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:14:58.746381 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:14:58.746391 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:14:58.746447 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:14:58.746906 (+ 459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:58.747665 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:58.748689 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:14:58.749083 (+ 394us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:14:58.749159 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:14:58.749886 (+ 727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:14:58.749887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:14:58.749888 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:14:58.750106 (+ 218us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:14:58.750125 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:14:58.750133 (+ 8us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:14:58.750196 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:14:58.750246 (+ 50us) server_negotiation.cc:299] Negotiation successful
0928 20:14:58.750298 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1481}
I20260928 20:14:58.753263 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28257
2026-09-28T20:14:58Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (1329 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:14:58 dist-test-slave-n45k krb5kdc[28358](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:14:58 dist-test-slave-n45k krb5kdc[28358](info): set up 2 sockets
Sep 28 20:14:58 dist-test-slave-n45k krb5kdc[28358](info): commencing operation
krb5kdc: starting...
W20260928 20:14:59.866793 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.096s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:14:59 dist-test-slave-n45k krb5kdc[28358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:14:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:14:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:14:59.988334 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35081
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:35081
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:00.069691 28371 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:00.069903 28371 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:00.069926 28371 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:00.071169 28371 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:00.071215 28371 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:00.071229 28371 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:00.071242 28371 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:00.071255 28371 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:00.072781 28371 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:35081
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35081
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28371
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:00.073053 28371 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:00.073287 28371 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:00.078248 28377 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.078243 28379 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.078423 28376 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:00.078452 28371 server_base.cc:1034] running on GCE node
I20260928 20:15:00.078701 28371 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:00.078999 28371 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:00.080188 28371 hybrid_clock.cc:648] HybridClock initialized: now 1790626500080118 us; error 83 us; skew 500 ppm
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:00.082783 28371 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:00.083264 28371 webserver.cc:460] Webserver started at http://127.24.190.62:38739/ using document root <none> and password file <none>
I20260928 20:15:00.083514 28371 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:00.083582 28371 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:00.083731 28371 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:00.084779 28371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "1a70ee152e6f4e46b3df8a04f87dc637"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "4ddf2be592e08cb560742ffabf163740"
server_key_iv: "d084b519baa00bcd15960bdcb75f941d"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.085137 28371 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "1a70ee152e6f4e46b3df8a04f87dc637"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "4ddf2be592e08cb560742ffabf163740"
server_key_iv: "d084b519baa00bcd15960bdcb75f941d"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.086544 28371 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260928 20:15:00.087291 28386 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.087512 28371 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:00.087625 28371 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "1a70ee152e6f4e46b3df8a04f87dc637"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "4ddf2be592e08cb560742ffabf163740"
server_key_iv: "d084b519baa00bcd15960bdcb75f941d"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.087711 28371 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:00.104306 28371 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:00.106762 28371 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:00.106931 28371 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:00.110854 28371 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:35081
I20260928 20:15:00.111004 28438 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:35081 every 8 connection(s)
I20260928 20:15:00.111279 28371 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:00.112293 28439 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:00.113229 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28371
I20260928 20:15:00.113338 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:00.113515 25336 external_mini_cluster.cc:1428] Setting key 67f501cfb8caa69f4a5e05d0953c1d6a
I20260928 20:15:00.115517 28439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637: Bootstrap starting.
I20260928 20:15:00.116130 28439 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:00.116416 28439 log.cc:824] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:00.117193 28439 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637: No bootstrap required, opened a new log
I20260928 20:15:00.119654 28439 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35081 } }
I20260928 20:15:00.119835 28439 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:00.119877 28439 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a70ee152e6f4e46b3df8a04f87dc637, State: Initialized, Role: FOLLOWER
I20260928 20:15:00.120021 28439 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35081 } }
I20260928 20:15:00.120165 28439 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:00.120200 28439 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:00.120240 28439 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 0 FOLLOWER]: Advancing to term 1
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626499, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:00.120940 28439 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35081 } }
I20260928 20:15:00.121029 28439 leader_election.cc:302] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1a70ee152e6f4e46b3df8a04f87dc637; no voters:
I20260928 20:15:00.121237 28439 leader_election.cc:288] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:00.121299 28444 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:00.121450 28444 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [term 1 LEADER]: Becoming Leader. State: Replica: 1a70ee152e6f4e46b3df8a04f87dc637, State: Running, Role: LEADER
I20260928 20:15:00.121515 28439 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:00.121804 28444 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35081 } }
I20260928 20:15:00.122510 28446 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1a70ee152e6f4e46b3df8a04f87dc637. Latest consensus state: current_term: 1 leader_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35081 } } }
I20260928 20:15:00.122602 28446 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:00.122746 28445 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1a70ee152e6f4e46b3df8a04f87dc637" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35081 } } }
I20260928 20:15:00.122823 28445 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637 [sys.catalog]: This master's current role is: LEADER
W20260928 20:15:00.123389 28459 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:15:00.123442 28459 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:15:00.123495 28456 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:00.123687 28456 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:00.125310 28456 catalog_manager.cc:1347] Generated new cluster ID: 1bbe12de0523431daf861123608a66bc
I20260928 20:15:00.125361 28456 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:00.125499 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.114066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42060 (local address 127.24.190.62:35081)
0928 20:15:00.114250 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:00.114257 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:00.114329 (+ 72us) server_negotiation.cc:407] Connection header received
0928 20:15:00.114735 (+ 406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:00.114741 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:00.114785 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:00.114938 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:00.115583 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.116633 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.117695 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.118144 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.118235 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.121225 (+ 2990us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:00.121229 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:00.121229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:00.121241 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:00.123401 (+ 2160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.123813 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.123816 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.123816 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.123917 (+ 101us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.124167 (+ 250us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.124168 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.124168 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.124468 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:00.124617 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:00.125133 (+ 516us) server_negotiation.cc:299] Negotiation successful
0928 20:15:00.125273 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":85,"threads_started":1}
I20260928 20:15:00.137687 28456 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:00.138233 28456 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:00.140614 28456 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1a70ee152e6f4e46b3df8a04f87dc637: Generated new TSK 0
I20260928 20:15:00.140878 28456 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:15:00.173576 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35081
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:00.256102 28465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:00.256330 28465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:00.256356 28465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:00.257563 28465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:00.257616 28465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:00.257644 28465 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:00.259248 28465 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:00.259503 28465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:00.259768 28465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:00.264878 28473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.264878 28470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.264895 28471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:00.265290 28465 server_base.cc:1034] running on GCE node
I20260928 20:15:00.265528 28465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:00.265786 28465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:00.267287 28465 hybrid_clock.cc:648] HybridClock initialized: now 1790626500267267 us; error 27 us; skew 500 ppm
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:00.269909 28465 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:15:00.270604 28465 webserver.cc:460] Webserver started at http://127.24.190.1:44885/ using document root <none> and password file <none>
I20260928 20:15:00.270857 28465 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:00.270925 28465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:00.271081 28465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:00.272207 28465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "c5540e05818543a8837e1817b5164c39"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "5112e49f61bccd637544df17dfcae758"
server_key_iv: "ac311f899e28e664173e5855967fa7aa"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.272655 28465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "c5540e05818543a8837e1817b5164c39"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "5112e49f61bccd637544df17dfcae758"
server_key_iv: "ac311f899e28e664173e5855967fa7aa"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.274204 28465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:00.274966 28480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.275128 28465 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:00.275231 28465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c5540e05818543a8837e1817b5164c39"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "5112e49f61bccd637544df17dfcae758"
server_key_iv: "ac311f899e28e664173e5855967fa7aa"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.275310 28465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:00.291710 28465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:00.294111 28465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:00.294312 28465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:00.294554 28465 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:00.294881 28465 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:00.294937 28465 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.294979 28465 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:00.295004 28465 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.300915 28465 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:37453
I20260928 20:15:00.300961 28593 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:37453 every 8 connection(s)
I20260928 20:15:00.301281 28465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:00.309154 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28465
I20260928 20:15:00.309257 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:00.309454 25336 external_mini_cluster.cc:1428] Setting key 7b38ceb54b96e7495f6ef53df5e0cd72
I20260928 20:15:00.311283 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.302016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:54363 (local address 127.24.190.62:35081)
0928 20:15:00.302107 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:00.302109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:00.302259 (+ 150us) server_negotiation.cc:407] Connection header received
0928 20:15:00.302873 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:00.302875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:00.302885 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:00.302939 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:00.303883 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.304501 (+ 618us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.305557 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.305773 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.305837 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.308062 (+ 2225us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:00.308063 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:00.308064 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:00.308071 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:00.309688 (+ 1617us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.310111 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.310113 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.310113 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.310183 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.310536 (+ 353us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.310537 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.310538 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.310688 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:00.310761 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:00.311021 (+ 260us) server_negotiation.cc:299] Negotiation successful
0928 20:15:00.311130 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260928 20:15:00.311311 28596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.301968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:35081 (local address 127.24.190.1:54363)
0928 20:15:00.302125 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:00.302162 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:00.302767 (+ 605us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:00.303001 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:00.303004 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:00.303570 (+ 566us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:00.303771 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:00.303775 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.304589 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.304590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:00.305456 (+ 866us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:00.305458 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.305852 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.305853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:00.305954 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.306535 (+ 581us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:00.306544 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:00.307951 (+ 1407us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:00.309772 (+ 1821us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:00.309779 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:00.309781 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:00.310017 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:00.310339 (+ 322us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:00.310339 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:00.310340 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:00.310461 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:00.310760 (+ 299us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:00.310766 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:00.310883 (+ 117us) client_negotiation.cc:769] Sending connection context
0928 20:15:00.310962 (+ 79us) client_negotiation.cc:240] Negotiation successful
0928 20:15:00.311084 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":99,"threads_started":1}
I20260928 20:15:00.311924 28594 heartbeater.cc:347] Connected to a master server at 127.24.190.62:35081
I20260928 20:15:00.312037 28594 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:00.312216 28594 heartbeater.cc:511] Master 127.24.190.62:35081 requested a full tablet report, sending...
I20260928 20:15:00.312783 28403 ts_manager.cc:194] Registered new tserver with Master: c5540e05818543a8837e1817b5164c39 (127.24.190.1:37453)
I20260928 20:15:00.313730 28403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:54363
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:15:00.337136 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35081
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:00.420627 28599 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:00.420881 28599 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:00.420922 28599 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:00.422219 28599 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:00.422313 28599 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:00.422390 28599 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:00.423985 28599 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28599
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:00.424264 28599 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:00.424510 28599 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:00.429836 28605 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.429867 28607 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.429824 28604 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:00.430102 28599 server_base.cc:1034] running on GCE node
I20260928 20:15:00.430495 28599 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:00.430703 28599 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:00.431862 28599 hybrid_clock.cc:648] HybridClock initialized: now 1790626500431840 us; error 36 us; skew 500 ppm
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:00.434592 28599 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:15:00.435098 28599 webserver.cc:460] Webserver started at http://127.24.190.2:41927/ using document root <none> and password file <none>
I20260928 20:15:00.435452 28599 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:00.435529 28599 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:00.435699 28599 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:00.436837 28599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "68e8ed9ef825426080b4f1e9a82264a6"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "5faf5b733f81d68bbde56338a6419a3e"
server_key_iv: "e61444717d471a7d88838a0179b8bdb0"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.437208 28599 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "68e8ed9ef825426080b4f1e9a82264a6"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "5faf5b733f81d68bbde56338a6419a3e"
server_key_iv: "e61444717d471a7d88838a0179b8bdb0"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.438616 28599 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260928 20:15:00.439345 28614 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.439517 28599 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:00.439612 28599 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "68e8ed9ef825426080b4f1e9a82264a6"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "5faf5b733f81d68bbde56338a6419a3e"
server_key_iv: "e61444717d471a7d88838a0179b8bdb0"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.439697 28599 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:00.458333 28599 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:00.460827 28599 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:00.461035 28599 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:00.461289 28599 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:00.461606 28599 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:00.461663 28599 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.461699 28599 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:00.461745 28599 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.467621 28599 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:40533
I20260928 20:15:00.467698 28727 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:40533 every 8 connection(s)
I20260928 20:15:00.468040 28599 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:00.472651 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28599
I20260928 20:15:00.472792 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:00.473055 25336 external_mini_cluster.cc:1428] Setting key 7585715915abfca197cf49128c6bb014
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:00.479163 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.468829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:37851 (local address 127.24.190.62:35081)
0928 20:15:00.468921 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:00.468924 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:00.469101 (+ 177us) server_negotiation.cc:407] Connection header received
0928 20:15:00.469621 (+ 520us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:00.469622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:00.469635 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:00.469704 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:00.470753 (+ 1049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.471273 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.472275 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.472481 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.472563 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.475343 (+ 2780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:00.475344 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:00.475345 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:00.475352 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:00.477465 (+ 2113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.477896 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.477897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.477898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.477968 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.478303 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.478305 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.478305 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.478437 (+ 132us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:00.478547 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:00.478962 (+ 415us) server_negotiation.cc:299] Negotiation successful
0928 20:15:00.479047 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 20:15:00.479530 28730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.468803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:35081 (local address 127.24.190.2:37851)
0928 20:15:00.468971 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:00.469018 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:00.469516 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:00.469792 (+ 276us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:00.469796 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:00.470444 (+ 648us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:00.470652 (+ 208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:00.470664 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.471365 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.471366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:00.472173 (+ 807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:00.472175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.472572 (+ 397us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.472573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:00.472704 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.473339 (+ 635us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:00.473348 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:00.475215 (+ 1867us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:00.477563 (+ 2348us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:00.477569 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:00.477571 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:00.477798 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:00.478044 (+ 246us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:00.478045 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:00.478045 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:00.478213 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:00.478554 (+ 341us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:00.478562 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:00.478754 (+ 192us) client_negotiation.cc:769] Sending connection context
0928 20:15:00.478884 (+ 130us) client_negotiation.cc:240] Negotiation successful
0928 20:15:00.479187 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260928 20:15:00.480093 28728 heartbeater.cc:347] Connected to a master server at 127.24.190.62:35081
I20260928 20:15:00.480193 28728 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:00.480384 28728 heartbeater.cc:511] Master 127.24.190.62:35081 requested a full tablet report, sending...
I20260928 20:15:00.480754 28403 ts_manager.cc:194] Registered new tserver with Master: 68e8ed9ef825426080b4f1e9a82264a6 (127.24.190.2:40533)
I20260928 20:15:00.481142 28403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:37851
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:15:00.501974 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35081
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37933
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:00.583879 28733 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:00.584084 28733 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:00.584106 28733 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:00.585256 28733 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:00.585299 28733 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:00.585325 28733 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:00.586894 28733 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37933
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35081
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28733
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:00.587141 28733 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:00.587374 28733 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:00.592428 28741 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.592422 28738 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:00.592519 28739 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:00.592576 28733 server_base.cc:1034] running on GCE node
I20260928 20:15:00.592847 28733 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:00.593071 28733 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:00.594218 28733 hybrid_clock.cc:648] HybridClock initialized: now 1790626500594247 us; error 95 us; skew 500 ppm
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:00.596855 28733 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:15:00.597411 28733 webserver.cc:460] Webserver started at http://127.24.190.3:43405/ using document root <none> and password file <none>
I20260928 20:15:00.597652 28733 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:00.597697 28733 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:00.597846 28733 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:00.598942 28733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "718e878a7d9149a1930db33c2a63464e"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "977fa5e50b4ea54f025a66bd8aa5dbaa"
server_key_iv: "ebef88fb232f62551498c60d86c64481"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.599303 28733 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "718e878a7d9149a1930db33c2a63464e"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "977fa5e50b4ea54f025a66bd8aa5dbaa"
server_key_iv: "ebef88fb232f62551498c60d86c64481"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.600672 28733 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:00.601451 28748 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.601640 28733 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:00.601742 28733 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "718e878a7d9149a1930db33c2a63464e"
format_stamp: "Formatted at 2026-09-28 20:15:00 on dist-test-slave-n45k"
server_key: "977fa5e50b4ea54f025a66bd8aa5dbaa"
server_key_iv: "ebef88fb232f62551498c60d86c64481"
server_key_version: "encryptionkey@0"
I20260928 20:15:00.601831 28733 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:00.628592 28733 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:00.631845 28733 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:00.631999 28733 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:00.632226 28733 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:00.632601 28733 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:00.632652 28733 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.632690 28733 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:00.632732 28733 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:00.640627 28733 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:40913
I20260928 20:15:00.640734 28861 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:40913 every 8 connection(s)
I20260928 20:15:00.641081 28733 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:00.647328 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28733
I20260928 20:15:00.647428 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:00.647620 25336 external_mini_cluster.cc:1428] Setting key bd558fcf21648f6528704c97a08ff180
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:00.653662 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.641922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:46817 (local address 127.24.190.62:35081)
0928 20:15:00.641964 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:00.641966 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:00.642230 (+ 264us) server_negotiation.cc:407] Connection header received
0928 20:15:00.643031 (+ 801us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:00.643033 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:00.643046 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:00.643102 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:00.644371 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.644938 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.646116 (+ 1178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.646512 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.646577 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.650186 (+ 3609us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:00.650187 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:00.650188 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:00.650196 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:00.652051 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.652488 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.652490 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.652490 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.652552 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.652815 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.652817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.652817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.653006 (+ 189us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:00.653093 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:00.653435 (+ 342us) server_negotiation.cc:299] Negotiation successful
0928 20:15:00.653535 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 20:15:00.653854 28864 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.641920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:35081 (local address 127.24.190.3:46817)
0928 20:15:00.642082 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:00.642128 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:00.642924 (+ 796us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:00.643182 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:00.643187 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:00.644014 (+ 827us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:00.644284 (+ 270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:00.644291 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.645035 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.645036 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:00.645979 (+ 943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:00.645981 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.646605 (+ 624us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.646607 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:00.646761 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.647854 (+ 1093us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:00.647865 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:00.650084 (+ 2219us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:00.652139 (+ 2055us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:00.652146 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:00.652148 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:00.652409 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:00.652607 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:00.652608 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:00.652608 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:00.652735 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:00.653086 (+ 351us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:00.653091 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:00.653278 (+ 187us) client_negotiation.cc:769] Sending connection context
0928 20:15:00.653389 (+ 111us) client_negotiation.cc:240] Negotiation successful
0928 20:15:00.653576 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":81,"threads_started":1}
I20260928 20:15:00.654368 28862 heartbeater.cc:347] Connected to a master server at 127.24.190.62:35081
I20260928 20:15:00.654486 28862 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:00.654703 28862 heartbeater.cc:511] Master 127.24.190.62:35081 requested a full tablet report, sending...
I20260928 20:15:00.655153 28403 ts_manager.cc:194] Registered new tserver with Master: 718e878a7d9149a1930db33c2a63464e (127.24.190.3:40913)
I20260928 20:15:00.655689 28403 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:46817
I20260928 20:15:00.659296 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28358](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626500, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:00.683524 28442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:00.675734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42072 (local address 127.24.190.62:35081)
0928 20:15:00.675820 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:00.675822 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:00.675862 (+ 40us) server_negotiation.cc:407] Connection header received
0928 20:15:00.675939 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:00.675940 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:00.675949 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:00.676010 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:00.676607 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.677112 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.678090 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:00.678360 (+ 270us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:00.678421 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:00.680864 (+ 2443us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:00.680865 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:00.680866 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:00.680872 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:00.682417 (+ 1545us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.682755 (+ 338us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.682756 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.682757 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.682808 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:00.683028 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:00.683030 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:00.683030 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:00.683201 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:00.683295 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:00.683390 (+ 95us) server_negotiation.cc:299] Negotiation successful
0928 20:15:00.683456 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
W20260928 20:15:00.683820 28403 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:42072
I20260928 20:15:00.684656 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28465
I20260928 20:15:00.689481 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28599
I20260928 20:15:00.693898 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28733
I20260928 20:15:00.698233 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28371
2026-09-28T20:15:00Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (1947 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28874](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28874](info): set up 2 sockets
Sep 28 20:15:00 dist-test-slave-n45k krb5kdc[28874](info): commencing operation
krb5kdc: starting...
W20260928 20:15:01.771674 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.053s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
W20260928 20:15:02.008023 25336 mini_kdc.cc:253] Time spent creating user principal test-admin: real 0.236s user 0.000s sys 0.001s
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
W20260928 20:15:02.245904 25336 mini_kdc.cc:253] Time spent creating user principal test-user: real 0.238s user 0.000s sys 0.001s
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
W20260928 20:15:02.495896 25336 mini_kdc.cc:253] Time spent creating user principal joe-interloper: real 0.250s user 0.000s sys 0.002s
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/test-user.keytab.
W20260928 20:15:03.241259 25336 mini_kdc.cc:302] Time spent creating keytab for test-user: real 0.745s user 0.000s sys 0.002s
Sep 28 20:15:03 dist-test-slave-n45k krb5kdc[28874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
W20260928 20:15:04.229511 25336 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.24.190.62: real 0.965s user 0.000s sys 0.003s
I20260928 20:15:04.229893 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35621
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:35621
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:04.314251 28887 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:04.314569 28887 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:04.314594 28887 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:04.315733 28887 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:04.315773 28887 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:04.315786 28887 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:04.315799 28887 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:04.315811 28887 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:04.317256 28887 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:35621
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35621
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28887
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:04.317520 28887 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:04.317710 28887 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:04.322688 28895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:04.322681 28892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:04.322681 28893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:04.323024 28887 server_base.cc:1034] running on GCE node
I20260928 20:15:04.323272 28887 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:04.323575 28887 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:04.324750 28887 hybrid_clock.cc:648] HybridClock initialized: now 1790626504324745 us; error 41 us; skew 500 ppm
Sep 28 20:15:04 dist-test-slave-n45k krb5kdc[28874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626504, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:04.333196 28887 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:04.333731 28887 webserver.cc:460] Webserver started at http://127.24.190.62:42691/ using document root <none> and password file <none>
I20260928 20:15:04.334031 28887 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:04.334108 28887 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:04.334262 28887 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:04.335521 28887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "88be3ba6b39746d29e7607eea40af6a8"
format_stamp: "Formatted at 2026-09-28 20:15:04 on dist-test-slave-n45k"
server_key: "434c634b41b29100f82d79edde1b31c6"
server_key_iv: "4226232830351d148d2e47351a2e85a1"
server_key_version: "encryptionkey@0"
I20260928 20:15:04.335908 28887 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "88be3ba6b39746d29e7607eea40af6a8"
format_stamp: "Formatted at 2026-09-28 20:15:04 on dist-test-slave-n45k"
server_key: "434c634b41b29100f82d79edde1b31c6"
server_key_iv: "4226232830351d148d2e47351a2e85a1"
server_key_version: "encryptionkey@0"
I20260928 20:15:04.337301 28887 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:15:04.338172 28902 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:04.338572 28887 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:04.338723 28887 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "88be3ba6b39746d29e7607eea40af6a8"
format_stamp: "Formatted at 2026-09-28 20:15:04 on dist-test-slave-n45k"
server_key: "434c634b41b29100f82d79edde1b31c6"
server_key_iv: "4226232830351d148d2e47351a2e85a1"
server_key_version: "encryptionkey@0"
I20260928 20:15:04.338804 28887 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:04.352689 28887 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:04.355278 28887 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:04.355476 28887 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:04.360193 28887 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:35621
I20260928 20:15:04.360531 28954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:35621 every 8 connection(s)
I20260928 20:15:04.360690 28887 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:04.361505 28955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:04.363981 28955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8: Bootstrap starting.
I20260928 20:15:04.364634 28955 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:04.364936 28955 log.cc:824] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:04.365202 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28887
I20260928 20:15:04.365321 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:04.365536 25336 external_mini_cluster.cc:1428] Setting key 696649616b98bb2ad20753c7f4311bec
I20260928 20:15:04.365866 28955 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8: No bootstrap required, opened a new log
I20260928 20:15:04.368186 28955 raft_consensus.cc:348] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88be3ba6b39746d29e7607eea40af6a8" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35621 } }
I20260928 20:15:04.368324 28955 raft_consensus.cc:374] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:04.368346 28955 raft_consensus.cc:729] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88be3ba6b39746d29e7607eea40af6a8, State: Initialized, Role: FOLLOWER
I20260928 20:15:04.368559 28955 consensus_queue.cc:260] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88be3ba6b39746d29e7607eea40af6a8" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35621 } }
I20260928 20:15:04.368654 28955 raft_consensus.cc:388] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:04.368690 28955 raft_consensus.cc:482] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:04.368748 28955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 0 FOLLOWER]: Advancing to term 1
Sep 28 20:15:04 dist-test-slave-n45k krb5kdc[28874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626503, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:04.378217 28959 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:04.366056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33808 (local address 127.24.190.62:35621)
0928 20:15:04.366256 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:04.366289 (+ 33us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:04.366338 (+ 49us) server_negotiation.cc:407] Connection header received
0928 20:15:04.368183 (+ 1845us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:04.368191 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:04.368250 (+ 59us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:04.368426 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:04.369241 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:04.370728 (+ 1487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:04.371782 (+ 1054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:04.372484 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:04.372611 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:04.375113 (+ 2502us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:04.375117 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:04.375117 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:04.375129 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:04.376654 (+ 1525us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:04.377032 (+ 378us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:04.377035 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:04.377035 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:04.377132 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:04.377347 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:04.377348 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:04.377348 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:04.377593 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:04.377717 (+ 124us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:04.377850 (+ 133us) server_negotiation.cc:299] Negotiation successful
0928 20:15:04.378000 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":91,"threads_started":1}
I20260928 20:15:04.429363 28955 raft_consensus.cc:504] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88be3ba6b39746d29e7607eea40af6a8" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35621 } }
I20260928 20:15:04.429581 28955 leader_election.cc:302] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 88be3ba6b39746d29e7607eea40af6a8; no voters:
I20260928 20:15:04.429844 28955 leader_election.cc:288] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:04.429955 28960 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:04.430136 28960 raft_consensus.cc:686] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [term 1 LEADER]: Becoming Leader. State: Replica: 88be3ba6b39746d29e7607eea40af6a8, State: Running, Role: LEADER
I20260928 20:15:04.430320 28960 consensus_queue.cc:237] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88be3ba6b39746d29e7607eea40af6a8" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35621 } }
I20260928 20:15:04.430348 28955 sys_catalog.cc:564] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:04.430799 28962 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 88be3ba6b39746d29e7607eea40af6a8. Latest consensus state: current_term: 1 leader_uuid: "88be3ba6b39746d29e7607eea40af6a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88be3ba6b39746d29e7607eea40af6a8" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35621 } } }
I20260928 20:15:04.430807 28961 sys_catalog.cc:455] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "88be3ba6b39746d29e7607eea40af6a8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "88be3ba6b39746d29e7607eea40af6a8" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35621 } } }
I20260928 20:15:04.430955 28961 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:04.431159 28962 sys_catalog.cc:458] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:04.431811 28965 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:04.432472 28965 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:04.434643 28965 catalog_manager.cc:1347] Generated new cluster ID: 71cdfb2338b540e2a03c5a01d15c7282
I20260928 20:15:04.434711 28965 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:04.441437 28965 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:04.442302 28965 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:04.447144 28965 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 88be3ba6b39746d29e7607eea40af6a8: Generated new TSK 0
I20260928 20:15:04.447356 28965 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
W20260928 20:15:05.793614 25336 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.24.190.1: real 1.341s user 0.000s sys 0.004s
I20260928 20:15:05.793993 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35621
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:05.876758 28981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:05.877024 28981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:05.877063 28981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:05.878298 28981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:05.878379 28981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:05.878448 28981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:05.880038 28981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.28981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:05.880332 28981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:05.880569 28981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:05.885699 28986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:05.885674 28987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:05.885795 28989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:05.886075 28981 server_base.cc:1034] running on GCE node
I20260928 20:15:05.886348 28981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:05.886603 28981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:05.887769 28981 hybrid_clock.cc:648] HybridClock initialized: now 1790626505887756 us; error 48 us; skew 500 ppm
Sep 28 20:15:05 dist-test-slave-n45k krb5kdc[28874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626505, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:05.890569 28981 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:15:05.891065 28981 webserver.cc:460] Webserver started at http://127.24.190.1:41661/ using document root <none> and password file <none>
I20260928 20:15:05.891294 28981 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:05.891359 28981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:05.891502 28981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:05.892586 28981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "e9c235bb5f5c4ae3be1f2edf07e46b82"
format_stamp: "Formatted at 2026-09-28 20:15:05 on dist-test-slave-n45k"
server_key: "49e0882975fe96f10adda6a51f31281b"
server_key_iv: "ff91588403f7d3574f0593c6dff779d4"
server_key_version: "encryptionkey@0"
I20260928 20:15:05.892970 28981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "e9c235bb5f5c4ae3be1f2edf07e46b82"
format_stamp: "Formatted at 2026-09-28 20:15:05 on dist-test-slave-n45k"
server_key: "49e0882975fe96f10adda6a51f31281b"
server_key_iv: "ff91588403f7d3574f0593c6dff779d4"
server_key_version: "encryptionkey@0"
I20260928 20:15:05.894728 28981 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.003s
I20260928 20:15:05.895596 28996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:05.895836 28981 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:05.895960 28981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "e9c235bb5f5c4ae3be1f2edf07e46b82"
format_stamp: "Formatted at 2026-09-28 20:15:05 on dist-test-slave-n45k"
server_key: "49e0882975fe96f10adda6a51f31281b"
server_key_iv: "ff91588403f7d3574f0593c6dff779d4"
server_key_version: "encryptionkey@0"
I20260928 20:15:05.896047 28981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:05.911682 28981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:05.913906 28981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:05.914079 28981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:05.914390 28981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:05.914710 28981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:05.914762 28981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:05.914803 28981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:05.914832 28981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:05.921135 28981 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:37323
I20260928 20:15:05.921175 29109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:37323 every 8 connection(s)
I20260928 20:15:05.921582 28981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:15:05 dist-test-slave-n45k krb5kdc[28874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626505, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:05.930014 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 28981
I20260928 20:15:05.930101 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:05.930424 25336 external_mini_cluster.cc:1428] Setting key 63caa2035fd4bcdb20f78c8f351b0231
I20260928 20:15:05.934703 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:05.922374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:53595 (local address 127.24.190.62:35621)
0928 20:15:05.922500 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:05.922502 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:05.922630 (+ 128us) server_negotiation.cc:407] Connection header received
0928 20:15:05.923759 (+ 1129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:05.923760 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:05.923772 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:05.923844 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:05.924687 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:05.925207 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:05.926689 (+ 1482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:05.926895 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:05.926958 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:05.929604 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:05.929605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:05.929606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:05.929613 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:05.931768 (+ 2155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:05.932344 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:05.932345 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:05.932346 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:05.932424 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:05.933695 (+ 1271us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:05.933696 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:05.933696 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:05.933862 (+ 166us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:05.933939 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:05.934438 (+ 499us) server_negotiation.cc:299] Negotiation successful
0928 20:15:05.934554 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":102,"thread_start_us":77,"threads_started":1}
I20260928 20:15:05.934827 29113 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:05.922346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:35621 (local address 127.24.190.1:53595)
0928 20:15:05.922514 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:05.922557 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:05.923606 (+ 1049us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:05.923957 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:05.923962 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:05.924295 (+ 333us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:05.924561 (+ 266us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:05.924566 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:05.925314 (+ 748us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:05.925315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:05.926596 (+ 1281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:05.926599 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:05.926985 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:05.926986 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:05.927131 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:05.927673 (+ 542us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:05.927683 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:05.929484 (+ 1801us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:05.931851 (+ 2367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:05.931860 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:05.931863 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:05.932249 (+ 386us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:05.933386 (+ 1137us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:05.933388 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:05.933388 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:05.933602 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:05.933944 (+ 342us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:05.933952 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:05.934095 (+ 143us) client_negotiation.cc:769] Sending connection context
0928 20:15:05.934408 (+ 313us) client_negotiation.cc:240] Negotiation successful
0928 20:15:05.934573 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":98,"threads_started":1}
I20260928 20:15:05.935457 29110 heartbeater.cc:347] Connected to a master server at 127.24.190.62:35621
I20260928 20:15:05.935554 29110 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:05.935775 29110 heartbeater.cc:511] Master 127.24.190.62:35621 requested a full tablet report, sending...
I20260928 20:15:05.936543 28919 ts_manager.cc:194] Registered new tserver with Master: e9c235bb5f5c4ae3be1f2edf07e46b82 (127.24.190.1:37323)
I20260928 20:15:05.937567 28919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:53595
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
W20260928 20:15:06.154241 25336 mini_kdc.cc:262] Time spent creating service keytab for kudu/127.24.190.2: real 0.223s user 0.002s sys 0.001s
I20260928 20:15:06.154659 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35621
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:06.236259 29116 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:06.236512 29116 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:06.236554 29116 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:06.237746 29116 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:06.237823 29116 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:06.237871 29116 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:06.239478 29116 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29116
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:06.239758 29116 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:06.239995 29116 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:06.245404 29124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:06.245407 29121 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:06.245543 29116 server_base.cc:1034] running on GCE node
W20260928 20:15:06.245635 29122 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:06.245911 29116 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:06.246136 29116 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:06.247298 29116 hybrid_clock.cc:648] HybridClock initialized: now 1790626506247288 us; error 33 us; skew 500 ppm
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:06.249919 29116 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:15:06.250396 29116 webserver.cc:460] Webserver started at http://127.24.190.2:36527/ using document root <none> and password file <none>
I20260928 20:15:06.250597 29116 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:06.250640 29116 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:06.250730 29116 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:06.251811 29116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "3014643320be40a1899a7a1134072150"
format_stamp: "Formatted at 2026-09-28 20:15:06 on dist-test-slave-n45k"
server_key: "4f1afb1a9879e043ae6787c328a5cdfd"
server_key_iv: "26dd78b28bee4b6b167c2395a6a28f00"
server_key_version: "encryptionkey@0"
I20260928 20:15:06.252107 29116 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "3014643320be40a1899a7a1134072150"
format_stamp: "Formatted at 2026-09-28 20:15:06 on dist-test-slave-n45k"
server_key: "4f1afb1a9879e043ae6787c328a5cdfd"
server_key_iv: "26dd78b28bee4b6b167c2395a6a28f00"
server_key_version: "encryptionkey@0"
I20260928 20:15:06.253559 29116 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:15:06.254262 29131 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:06.254479 29116 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:06.254582 29116 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "3014643320be40a1899a7a1134072150"
format_stamp: "Formatted at 2026-09-28 20:15:06 on dist-test-slave-n45k"
server_key: "4f1afb1a9879e043ae6787c328a5cdfd"
server_key_iv: "26dd78b28bee4b6b167c2395a6a28f00"
server_key_version: "encryptionkey@0"
I20260928 20:15:06.254666 29116 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:06.265556 29116 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:06.268025 29116 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:06.268193 29116 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:06.268447 29116 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:06.268765 29116 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:06.268821 29116 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:06.268863 29116 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:06.268889 29116 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:06.274712 29116 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:40535
I20260928 20:15:06.274768 29244 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:40535 every 8 connection(s)
I20260928 20:15:06.275112 29116 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:06.279837 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29116
I20260928 20:15:06.279989 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:06.280212 25336 external_mini_cluster.cc:1428] Setting key 6530d130b253ca69844dade9028fe7d7
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:06.285868 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:06.275967 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:53589 (local address 127.24.190.62:35621)
0928 20:15:06.276035 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:06.276037 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:06.276244 (+ 207us) server_negotiation.cc:407] Connection header received
0928 20:15:06.277216 (+ 972us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:06.277218 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:06.277231 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:06.277289 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:06.277952 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.278608 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.279617 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.279822 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.279882 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:06.282740 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:06.282742 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:06.282742 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:06.282750 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:06.284256 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.284787 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.284788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.284789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.284861 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.285153 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.285154 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.285154 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.285266 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:06.285319 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:06.285688 (+ 369us) server_negotiation.cc:299] Negotiation successful
0928 20:15:06.285775 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 20:15:06.286196 29247 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:06.275951 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:35621 (local address 127.24.190.2:53589)
0928 20:15:06.276123 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:06.276160 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:06.277105 (+ 945us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:06.277394 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:06.277398 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:06.277655 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:06.277848 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:06.277852 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.278693 (+ 841us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.278695 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:06.279535 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:06.279537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.279915 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.279916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:06.280076 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:06.280703 (+ 627us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:06.280712 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:06.282617 (+ 1905us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:06.284342 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:06.284349 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:06.284351 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:06.284696 (+ 345us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:06.284931 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:06.284932 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:06.284932 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:06.285085 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:06.285335 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:06.285342 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:06.285527 (+ 185us) client_negotiation.cc:769] Sending connection context
0928 20:15:06.285670 (+ 143us) client_negotiation.cc:240] Negotiation successful
0928 20:15:06.285900 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":89,"threads_started":1}
I20260928 20:15:06.286832 29245 heartbeater.cc:347] Connected to a master server at 127.24.190.62:35621
I20260928 20:15:06.286966 29245 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:06.287216 29245 heartbeater.cc:511] Master 127.24.190.62:35621 requested a full tablet report, sending...
I20260928 20:15:06.287662 28919 ts_manager.cc:194] Registered new tserver with Master: 3014643320be40a1899a7a1134072150 (127.24.190.2:40535)
I20260928 20:15:06.288056 28919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:53589
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:15:06.309329 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35621
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:38285
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:06.393332 29250 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:06.393582 29250 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:06.393625 29250 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:06.394996 29250 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:06.395066 29250 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:06.395114 29250 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:06.396766 29250 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38285
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:35621
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29250
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:06.397046 29250 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:06.397296 29250 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:06.403226 29255 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:06.403266 29256 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:06.403264 29250 server_base.cc:1034] running on GCE node
W20260928 20:15:06.403247 29258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:06.403774 29250 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:06.404101 29250 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:06.405324 29250 hybrid_clock.cc:648] HybridClock initialized: now 1790626506405224 us; error 118 us; skew 500 ppm
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:06.408290 29250 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:15:06.408864 29250 webserver.cc:460] Webserver started at http://127.24.190.3:43691/ using document root <none> and password file <none>
I20260928 20:15:06.409137 29250 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:06.409189 29250 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:06.409336 29250 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:06.410677 29250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "54ba0c2fdb7a4f688f27a5f93748851d"
format_stamp: "Formatted at 2026-09-28 20:15:06 on dist-test-slave-n45k"
server_key: "00db390ba29ccc18fd3ac55c5d9f9765"
server_key_iv: "b039dd3c833c7358c63b3a9ac181eaf2"
server_key_version: "encryptionkey@0"
I20260928 20:15:06.411108 29250 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "54ba0c2fdb7a4f688f27a5f93748851d"
format_stamp: "Formatted at 2026-09-28 20:15:06 on dist-test-slave-n45k"
server_key: "00db390ba29ccc18fd3ac55c5d9f9765"
server_key_iv: "b039dd3c833c7358c63b3a9ac181eaf2"
server_key_version: "encryptionkey@0"
I20260928 20:15:06.412624 29250 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:06.413671 29265 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:06.413853 29250 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:06.413951 29250 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "54ba0c2fdb7a4f688f27a5f93748851d"
format_stamp: "Formatted at 2026-09-28 20:15:06 on dist-test-slave-n45k"
server_key: "00db390ba29ccc18fd3ac55c5d9f9765"
server_key_iv: "b039dd3c833c7358c63b3a9ac181eaf2"
server_key_version: "encryptionkey@0"
I20260928 20:15:06.414012 29250 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:06.431875 29250 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:06.434201 29250 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:06.434404 29250 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:06.434634 29250 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:06.434918 29250 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:06.434957 29250 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:06.434981 29250 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:06.434995 29250 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:06.441787 29250 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:40159
I20260928 20:15:06.441874 29378 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:40159 every 8 connection(s)
I20260928 20:15:06.442225 29250 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:06.444689 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29250
I20260928 20:15:06.444796 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:06.445004 25336 external_mini_cluster.cc:1428] Setting key 2af1132188b6e632d710ef7677b5bd4f
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:06.452658 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:06.443053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:54613 (local address 127.24.190.62:35621)
0928 20:15:06.443136 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:06.443139 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:06.443343 (+ 204us) server_negotiation.cc:407] Connection header received
0928 20:15:06.444409 (+ 1066us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:06.444410 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:06.444421 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:06.444511 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:06.445414 (+ 903us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.446173 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.447330 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.447530 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.447590 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:06.449813 (+ 2223us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:06.449815 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:06.449815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:06.449822 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:06.451333 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.451729 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.451730 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.451731 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.451781 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.452003 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.452003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.452004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.452176 (+ 172us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:06.452230 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:06.452510 (+ 280us) server_negotiation.cc:299] Negotiation successful
0928 20:15:06.452582 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260928 20:15:06.452863 29381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:06.443002 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:35621 (local address 127.24.190.3:54613)
0928 20:15:06.443198 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:06.443239 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:06.444284 (+ 1045us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:06.444575 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:06.444578 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:06.444984 (+ 406us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:06.445321 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:06.445328 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.446291 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.446292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:06.447247 (+ 955us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:06.447250 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.447612 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.447613 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:06.447729 (+ 116us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:06.448247 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:06.448256 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:06.449690 (+ 1434us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:06.451415 (+ 1725us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:06.451421 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:06.451423 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:06.451662 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:06.451842 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:06.451842 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:06.451842 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:06.451946 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:06.452237 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:06.452241 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:06.452363 (+ 122us) client_negotiation.cc:769] Sending connection context
0928 20:15:06.452453 (+ 90us) client_negotiation.cc:240] Negotiation successful
0928 20:15:06.452582 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":104,"threads_started":1}
I20260928 20:15:06.453498 29379 heartbeater.cc:347] Connected to a master server at 127.24.190.62:35621
I20260928 20:15:06.453615 29379 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:06.453797 29379 heartbeater.cc:511] Master 127.24.190.62:35621 requested a full tablet report, sending...
I20260928 20:15:06.454195 28919 ts_manager.cc:194] Registered new tserver with Master: 54ba0c2fdb7a4f688f27a5f93748851d (127.24.190.3:40159)
I20260928 20:15:06.454581 28919 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:54613
I20260928 20:15:06.456756 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:15:06.479857 29386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:06.472087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50572 (local address 127.24.190.1:37323)
0928 20:15:06.472232 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:06.472237 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:06.472250 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:15:06.472287 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:06.472290 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:06.472308 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:06.472374 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:06.472979 (+ 605us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.473772 (+ 793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.474573 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.474934 (+ 361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.474994 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:06.477152 (+ 2158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:06.477159 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:06.477160 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:06.477166 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:06.478885 (+ 1719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.479190 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.479193 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.479193 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.479246 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.479405 (+ 159us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.479405 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.479406 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.479527 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:06.479635 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:06.479690 (+ 55us) server_negotiation.cc:299] Negotiation successful
0928 20:15:06.479782 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":71,"threads_started":1}
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[28874](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626506, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:06.488085 29112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:06.481144 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54894 (local address 127.24.190.62:35621)
0928 20:15:06.481203 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:06.481206 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:06.481214 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:06.481245 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:06.481246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:06.481315 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:06.481363 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:06.481813 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.482446 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.483134 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:06.483345 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:06.483410 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:06.485547 (+ 2137us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:06.485548 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:06.485549 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:06.485556 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:06.486970 (+ 1414us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.487311 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.487312 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.487312 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.487368 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:06.487556 (+ 188us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:06.487556 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:06.487557 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:06.487710 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:06.487797 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:06.487889 (+ 92us) server_negotiation.cc:299] Negotiation successful
0928 20:15:06.487954 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
W20260928 20:15:06.488360 28919 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54894
I20260928 20:15:06.488763 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28981
I20260928 20:15:06.493690 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29116
I20260928 20:15:06.498342 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29250
I20260928 20:15:06.502813 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 28887
2026-09-28T20:15:06Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (5804 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[29391](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[29391](info): set up 2 sockets
Sep 28 20:15:06 dist-test-slave-n45k krb5kdc[29391](info): commencing operation
krb5kdc: starting...
W20260928 20:15:07.614723 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.092s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:07 dist-test-slave-n45k krb5kdc[29391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:15:07.738795 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:36565
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:36565
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:07.819656 29404 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:07.819924 29404 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:07.819967 29404 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:07.821126 29404 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:07.821201 29404 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:07.821225 29404 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:07.821246 29404 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:07.821277 29404 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:07.822829 29404 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:36565
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:36565
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29404
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:07.823117 29404 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:07.823355 29404 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:07.828315 29412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:07.828528 29404 server_base.cc:1034] running on GCE node
W20260928 20:15:07.828312 29409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:07.828315 29410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:07.828886 29404 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:07.829126 29404 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:07.830299 29404 hybrid_clock.cc:648] HybridClock initialized: now 1790626507830253 us; error 36 us; skew 500 ppm
Sep 28 20:15:07 dist-test-slave-n45k krb5kdc[29391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626507, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:07.832720 29404 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:07.833135 29404 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:07.833207 29404 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:07.833357 29404 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:07.834493 29404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e"
format_stamp: "Formatted at 2026-09-28 20:15:07 on dist-test-slave-n45k"
server_key: "570de2e0d01609324ebdac3ad00fba92"
server_key_iv: "3d4a46a61df0f1acd11f5a98103d21e7"
server_key_version: "encryptionkey@0"
I20260928 20:15:07.834860 29404 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e"
format_stamp: "Formatted at 2026-09-28 20:15:07 on dist-test-slave-n45k"
server_key: "570de2e0d01609324ebdac3ad00fba92"
server_key_iv: "3d4a46a61df0f1acd11f5a98103d21e7"
server_key_version: "encryptionkey@0"
I20260928 20:15:07.836123 29404 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:07.836969 29418 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:07.837329 29404 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:07.837435 29404 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e"
format_stamp: "Formatted at 2026-09-28 20:15:07 on dist-test-slave-n45k"
server_key: "570de2e0d01609324ebdac3ad00fba92"
server_key_iv: "3d4a46a61df0f1acd11f5a98103d21e7"
server_key_version: "encryptionkey@0"
I20260928 20:15:07.837515 29404 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:07.853259 29404 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:07.855221 29404 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:07.855404 29404 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:07.859550 29404 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:36565
I20260928 20:15:07.859601 29470 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:36565 every 8 connection(s)
I20260928 20:15:07.859917 29404 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:07.860950 29471 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:07.863274 29471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e: Bootstrap starting.
I20260928 20:15:07.863687 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29404
I20260928 20:15:07.863811 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:07.864017 29471 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:07.864020 25336 external_mini_cluster.cc:1428] Setting key 7d27c8cafa3c231864978610fa2590b8
I20260928 20:15:07.864353 29471 log.cc:824] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:07.865190 29471 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e: No bootstrap required, opened a new log
I20260928 20:15:07.867583 29471 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36565 } }
I20260928 20:15:07.867764 29471 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:07.867842 29471 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f9ee4c65d64b2aaa8a736b9b1a226e, State: Initialized, Role: FOLLOWER
I20260928 20:15:07.867983 29471 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36565 } }
I20260928 20:15:07.868057 29471 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:07.868079 29471 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:07.868155 29471 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:07.868781 29471 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36565 } }
I20260928 20:15:07.868883 29471 leader_election.cc:302] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57f9ee4c65d64b2aaa8a736b9b1a226e; no voters:
I20260928 20:15:07.869035 29471 leader_election.cc:288] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:07.869099 29476 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:07.869258 29476 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [term 1 LEADER]: Becoming Leader. State: Replica: 57f9ee4c65d64b2aaa8a736b9b1a226e, State: Running, Role: LEADER
I20260928 20:15:07.869309 29471 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:07.869391 29476 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36565 } }
I20260928 20:15:07.869797 29476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57f9ee4c65d64b2aaa8a736b9b1a226e. Latest consensus state: current_term: 1 leader_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36565 } } }
I20260928 20:15:07.869884 29476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:07.870031 29477 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f9ee4c65d64b2aaa8a736b9b1a226e" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36565 } } }
I20260928 20:15:07.870174 29477 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:07.870999 29482 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:07.871539 29482 catalog_manager.cc:1484] Initializing Kudu cluster ID...
Sep 28 20:15:07 dist-test-slave-n45k krb5kdc[29391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626507, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:07.873456 29482 catalog_manager.cc:1347] Generated new cluster ID: 5da2857029fa453ca5675e040e9dcdb7
I20260928 20:15:07.873519 29482 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:07.876657 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:07.864539 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53402 (local address 127.24.190.62:36565)
0928 20:15:07.864684 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:07.864693 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:07.864725 (+ 32us) server_negotiation.cc:407] Connection header received
0928 20:15:07.865323 (+ 598us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:07.865333 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:07.865430 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:07.865596 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:07.866163 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:07.867643 (+ 1480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:07.868662 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:07.869295 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:07.869750 (+ 455us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:07.872550 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:07.872554 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:07.872555 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:07.872566 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:07.874885 (+ 2319us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:07.875291 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:07.875296 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:07.875297 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:07.875419 (+ 122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:07.875625 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:07.875626 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:07.875626 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:07.875986 (+ 360us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:07.876175 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:07.876255 (+ 80us) server_negotiation.cc:299] Negotiation successful
0928 20:15:07.876411 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":64,"threads_started":1}
I20260928 20:15:07.882908 29482 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:07.883708 29482 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:07.887373 29482 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e: Generated new TSK 0
I20260928 20:15:07.887557 29482 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:15:07.921579 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:36565
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:08.002995 29497 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.003206 29497 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.003230 29497 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.004403 29497 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.004443 29497 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.004470 29497 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:08.006063 29497 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29497
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.006302 29497 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.006572 29497 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.012360 29502 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.012377 29497 server_base.cc:1034] running on GCE node
W20260928 20:15:08.012347 29505 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.012347 29503 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.012889 29497 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.013111 29497 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.014343 29497 hybrid_clock.cc:648] HybridClock initialized: now 1790626508014316 us; error 27 us; skew 500 ppm
Sep 28 20:15:08 dist-test-slave-n45k krb5kdc[29391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626508, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:08.017198 29497 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:15:08.017541 29497 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.017589 29497 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.017689 29497 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.018890 29497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "963cd091886a4a53bbda95ccaae3e30b"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "a54b45c592d364b8d76051065b23ac84"
server_key_iv: "768555733e3edd2aec2c3454a1a062d8"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.019224 29497 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "963cd091886a4a53bbda95ccaae3e30b"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "a54b45c592d364b8d76051065b23ac84"
server_key_iv: "768555733e3edd2aec2c3454a1a062d8"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.020596 29497 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:08.021327 29511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.021523 29497 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:08.021612 29497 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "963cd091886a4a53bbda95ccaae3e30b"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "a54b45c592d364b8d76051065b23ac84"
server_key_iv: "768555733e3edd2aec2c3454a1a062d8"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.021668 29497 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:08.032039 29497 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:08.033944 29497 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:08.034057 29497 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:08.034242 29497 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:08.034641 29497 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:08.034677 29497 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.034699 29497 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:08.034713 29497 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.040452 29497 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:35211
I20260928 20:15:08.040505 29624 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:35211 every 8 connection(s)
I20260928 20:15:08.040831 29497 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:08.046600 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29497
I20260928 20:15:08.046762 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:08.046944 25336 external_mini_cluster.cc:1428] Setting key 8f616fefb8f94e92fd4a7b2c710986ae
Sep 28 20:15:08 dist-test-slave-n45k krb5kdc[29391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626508, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:08.051344 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.041562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:57493 (local address 127.24.190.62:36565)
0928 20:15:08.041634 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.041636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.041862 (+ 226us) server_negotiation.cc:407] Connection header received
0928 20:15:08.042527 (+ 665us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.042528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.042540 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.042601 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.043576 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.044087 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.045083 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.045373 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.045432 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.047959 (+ 2527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.047960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.047960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:08.047967 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.049769 (+ 1802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.050191 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.050192 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.050193 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.050361 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.050624 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.050625 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.050626 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.050755 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.050831 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.051145 (+ 314us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.051253 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 20:15:08.051522 29627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.041535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:36565 (local address 127.24.190.1:57493)
0928 20:15:08.041731 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.041773 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.042284 (+ 511us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.042685 (+ 401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.042689 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.042950 (+ 261us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:08.043478 (+ 528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.043484 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.044186 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.044187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.045003 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.045006 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.045453 (+ 447us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.045453 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.045554 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.046106 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:08.046122 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:08.047851 (+ 1729us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:08.049862 (+ 2011us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:08.049869 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:08.049870 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:08.050101 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:08.050435 (+ 334us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:08.050436 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:08.050437 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:08.050554 (+ 117us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:08.050832 (+ 278us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:08.050840 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:08.051000 (+ 160us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.051112 (+ 112us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.051276 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":130,"threads_started":1}
I20260928 20:15:08.052143 29625 heartbeater.cc:347] Connected to a master server at 127.24.190.62:36565
I20260928 20:15:08.052289 29625 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:08.052464 29625 heartbeater.cc:511] Master 127.24.190.62:36565 requested a full tablet report, sending...
I20260928 20:15:08.053053 29435 ts_manager.cc:194] Registered new tserver with Master: 963cd091886a4a53bbda95ccaae3e30b (127.24.190.1:35211)
I20260928 20:15:08.054106 29435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:57493
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:15:08.074437 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:36565
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:08.156322 29630 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.156538 29630 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.156563 29630 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.157750 29630 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.157795 29630 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.157822 29630 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:08.159430 29630 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29630
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.159690 29630 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.159934 29630 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.165104 29635 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.165148 29638 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.165120 29636 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.165243 29630 server_base.cc:1034] running on GCE node
I20260928 20:15:08.165689 29630 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.165987 29630 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.167174 29630 hybrid_clock.cc:648] HybridClock initialized: now 1790626508167154 us; error 36 us; skew 500 ppm
Sep 28 20:15:08 dist-test-slave-n45k krb5kdc[29391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626508, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:08.170161 29630 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:15:08.170549 29630 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.170599 29630 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.170778 29630 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.171900 29630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "87d4653c2c0d41388b9e37a2becad986"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "85997a63a9f975aa1e405f0f3cf1756e"
server_key_iv: "e56b2cda0facce463de8516f1f0682b1"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.172267 29630 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "87d4653c2c0d41388b9e37a2becad986"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "85997a63a9f975aa1e405f0f3cf1756e"
server_key_iv: "e56b2cda0facce463de8516f1f0682b1"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.173686 29630 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:15:08.174531 29644 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.174770 29630 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:08.174888 29630 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "87d4653c2c0d41388b9e37a2becad986"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "85997a63a9f975aa1e405f0f3cf1756e"
server_key_iv: "e56b2cda0facce463de8516f1f0682b1"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.174965 29630 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:08.214156 29630 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:08.216270 29630 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:08.216468 29630 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:08.216724 29630 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:08.217060 29630 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:08.217119 29630 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.217162 29630 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:08.217186 29630 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.223323 29630 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:37951
I20260928 20:15:08.223379 29757 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:37951 every 8 connection(s)
I20260928 20:15:08.223692 29630 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:08.229735 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29630
I20260928 20:15:08.229882 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:08.230120 25336 external_mini_cluster.cc:1428] Setting key afb3504983d35f80346a752516db5f44
Sep 28 20:15:08 dist-test-slave-n45k krb5kdc[29391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626508, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:08.234238 29760 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.224469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:36565 (local address 127.24.190.2:53727)
0928 20:15:08.224639 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.224675 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.225219 (+ 544us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.225504 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.225528 (+ 24us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.225815 (+ 287us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:08.226401 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.226407 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.227156 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.227158 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.227986 (+ 828us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.227988 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.228415 (+ 427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.228416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.228560 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.229145 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:08.229153 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:08.230861 (+ 1708us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:08.232859 (+ 1998us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:08.232865 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:08.232867 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:08.233104 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:08.233323 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:08.233324 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:08.233324 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:08.233450 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:08.233741 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:08.233745 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:08.233866 (+ 121us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.233951 (+ 85us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.234073 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":78,"threads_started":1}
I20260928 20:15:08.234242 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.224486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:53727 (local address 127.24.190.62:36565)
0928 20:15:08.224542 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.224543 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.224760 (+ 217us) server_negotiation.cc:407] Connection header received
0928 20:15:08.225359 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.225360 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.225374 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.225430 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.226503 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.227054 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.228101 (+ 1047us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.228309 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.228403 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.230965 (+ 2562us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.230967 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.230967 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:08.230974 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.232761 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.233185 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.233187 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.233187 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.233253 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.233517 (+ 264us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.233518 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.233519 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.233675 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.233746 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.233998 (+ 252us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.234097 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:08.234826 29758 heartbeater.cc:347] Connected to a master server at 127.24.190.62:36565
I20260928 20:15:08.234946 29758 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:08.235100 29758 heartbeater.cc:511] Master 127.24.190.62:36565 requested a full tablet report, sending...
I20260928 20:15:08.235502 29435 ts_manager.cc:194] Registered new tserver with Master: 87d4653c2c0d41388b9e37a2becad986 (127.24.190.2:37951)
I20260928 20:15:08.236073 29435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:53727
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:15:08.258898 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:36565
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35277
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:08.339890 29763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.340199 29763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.340233 29763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.341564 29763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.341606 29763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.341634 29763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:08.343209 29763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35277
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:36565
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.343468 29763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.343716 29763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.349329 29768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.349359 29763 server_base.cc:1034] running on GCE node
W20260928 20:15:08.349372 29771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.349329 29769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.349835 29763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.350104 29763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.351267 29763 hybrid_clock.cc:648] HybridClock initialized: now 1790626508351271 us; error 63 us; skew 500 ppm
Sep 28 20:15:08 dist-test-slave-n45k krb5kdc[29391](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626508, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:08.353966 29763 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:15:08.354378 29763 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.354432 29763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.354522 29763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.355553 29763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "d5e6379e04cc48f19fc9fc139be3ecbd"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "16ad321687cab5f850d5a0c4a9cd22c8"
server_key_iv: "7291f72b07b897ba46eed4ed254aac8d"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.355856 29763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "d5e6379e04cc48f19fc9fc139be3ecbd"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "16ad321687cab5f850d5a0c4a9cd22c8"
server_key_iv: "7291f72b07b897ba46eed4ed254aac8d"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.357215 29763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:08.357910 29777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.358129 29763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:08.358254 29763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "d5e6379e04cc48f19fc9fc139be3ecbd"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "16ad321687cab5f850d5a0c4a9cd22c8"
server_key_iv: "7291f72b07b897ba46eed4ed254aac8d"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.358376 29763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:08.373167 29763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:08.375258 29763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:08.375422 29763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:08.375677 29763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:08.375986 29763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:08.376041 29763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.376084 29763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:08.376109 29763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.381937 29763 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:37445
I20260928 20:15:08.382014 29890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:37445 every 8 connection(s)
I20260928 20:15:08.382345 29763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:08.383919 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29763
I20260928 20:15:08.384027 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:08.384203 25336 external_mini_cluster.cc:1428] Setting key 3c87183cade09fd27aff8aee83e708e2
Sep 28 20:15:08 dist-test-slave-n45k krb5kdc[29391](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626508, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:08.393234 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.383112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:58447 (local address 127.24.190.62:36565)
0928 20:15:08.383188 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.383190 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.383474 (+ 284us) server_negotiation.cc:407] Connection header received
0928 20:15:08.384004 (+ 530us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.384005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.384017 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.384074 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.385259 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.386000 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.387556 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.387899 (+ 343us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.387948 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.390734 (+ 2786us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.390736 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.390736 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:08.390744 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.391866 (+ 1122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.392275 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.392276 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.392276 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.392335 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.392593 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.392594 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.392594 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.392720 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.392796 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.393066 (+ 270us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.393143 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:15:08.393428 29893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.383098 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:36565 (local address 127.24.190.3:58447)
0928 20:15:08.383350 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.383386 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.383898 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.384167 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.384170 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.384465 (+ 295us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:08.385175 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.385180 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.386112 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.386113 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.387449 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.387452 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.388039 (+ 587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.388039 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.388143 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.388695 (+ 552us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:08.388704 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:08.390636 (+ 1932us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:08.391963 (+ 1327us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:08.391970 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:08.391972 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:08.392198 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:08.392411 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:08.392411 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:08.392412 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:08.392525 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:08.392786 (+ 261us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:08.392792 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:08.392930 (+ 138us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.393031 (+ 101us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.393195 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":215,"thread_start_us":80,"threads_started":1}
I20260928 20:15:08.393924 29891 heartbeater.cc:347] Connected to a master server at 127.24.190.62:36565
I20260928 20:15:08.394022 29891 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:08.394137 29891 heartbeater.cc:511] Master 127.24.190.62:36565 requested a full tablet report, sending...
I20260928 20:15:08.394601 29435 ts_manager.cc:194] Registered new tserver with Master: d5e6379e04cc48f19fc9fc139be3ecbd (127.24.190.3:37445)
I20260928 20:15:08.395023 29435 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:58447
I20260928 20:15:08.395999 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:15:08.403190 29475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.397233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53404 (local address 127.24.190.62:36565)
0928 20:15:08.397358 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.397360 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.397376 (+ 16us) server_negotiation.cc:407] Connection header received
0928 20:15:08.397430 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.397431 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.397439 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.397484 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.397965 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.398557 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.399232 (+ 675us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.399553 (+ 321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.399620 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.400673 (+ 1053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.400674 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.400674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:08.400680 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.402114 (+ 1434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.402524 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.402525 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.402525 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.402577 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:08.402754 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:08.402755 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:08.402755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:08.402881 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.402952 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.403041 (+ 89us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.403100 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260928 20:15:08.405107 29435 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53404:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:08.406716 29435 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:08.413707 29902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.409091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:37445 (local address 127.0.0.1:39822)
0928 20:15:08.409440 (+ 349us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.409483 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.409553 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.409928 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.409931 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.409934 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:08.410033 (+ 99us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.410035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.410986 (+ 951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.410987 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.412208 (+ 1221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.412210 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.413406 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.413407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.413494 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.413508 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.413580 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.413630 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"mutex_wait_us":2,"thread_start_us":84,"threads_started":1}
I20260928 20:15:08.413720 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.409191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39822 (local address 127.24.190.3:37445)
0928 20:15:08.409379 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.409384 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.409638 (+ 254us) server_negotiation.cc:407] Connection header received
0928 20:15:08.409744 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.409747 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.409763 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.409831 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:08.410112 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.410884 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.412337 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.413307 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.413388 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.413451 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.413622 (+ 171us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.413660 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":87,"threads_started":1}
I20260928 20:15:08.414142 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.409091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:37951 (local address 127.0.0.1:45326)
0928 20:15:08.409448 (+ 357us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.409483 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.409587 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.409943 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.409944 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.409945 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:08.410027 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.410029 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.411370 (+ 1341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.411371 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.412401 (+ 1030us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.412403 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.413902 (+ 1499us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.413903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.413971 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.413974 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.414026 (+ 52us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.414070 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":332,"mutex_wait_us":25,"thread_start_us":52,"threads_started":1}
I20260928 20:15:08.414397 29903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.409280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:35211 (local address 127.0.0.1:37162)
0928 20:15:08.409441 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.409483 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.409553 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.409929 (+ 376us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.409934 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.409937 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:08.410010 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.410012 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.412468 (+ 2456us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.412469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.413144 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.413146 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.414142 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.414142 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.414210 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.414214 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.414299 (+ 85us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.414337 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":73,"threads_started":1}
I20260928 20:15:08.414546 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.409209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45326 (local address 127.24.190.2:37951)
0928 20:15:08.409381 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.409384 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.409553 (+ 169us) server_negotiation.cc:407] Connection header received
0928 20:15:08.409724 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.409727 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.409744 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.409822 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:08.410134 (+ 312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.411260 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.412499 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.413303 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.413392 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.413451 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.414344 (+ 893us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.414386 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":74,"threads_started":1}
I20260928 20:15:08.414640 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.409444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37162 (local address 127.24.190.1:35211)
0928 20:15:08.409625 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.409630 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.409639 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:08.409680 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.409682 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.409696 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.409834 (+ 138us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:08.410080 (+ 246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.411251 (+ 1171us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.413236 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.414002 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.414059 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.414111 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.414510 (+ 399us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.414551 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":78,"threads_started":1}
I20260928 20:15:08.414559 29825 tablet_service.cc:1467] Processing CreateTablet for tablet 1a16ffeaf79f49adab0a5418b03b539f (DEFAULT_TABLE table=test-table [id=9c64d897d25d40dba849eda6a8238bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:08.414939 29825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a16ffeaf79f49adab0a5418b03b539f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:08.415275 29692 tablet_service.cc:1467] Processing CreateTablet for tablet 1a16ffeaf79f49adab0a5418b03b539f (DEFAULT_TABLE table=test-table [id=9c64d897d25d40dba849eda6a8238bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:08.415334 29559 tablet_service.cc:1467] Processing CreateTablet for tablet 1a16ffeaf79f49adab0a5418b03b539f (DEFAULT_TABLE table=test-table [id=9c64d897d25d40dba849eda6a8238bb0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:08.415499 29692 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a16ffeaf79f49adab0a5418b03b539f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:08.415642 29559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1a16ffeaf79f49adab0a5418b03b539f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:08.418061 29908 tablet_bootstrap.cc:492] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Bootstrap starting.
I20260928 20:15:08.418248 29909 tablet_bootstrap.cc:492] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Bootstrap starting.
I20260928 20:15:08.418751 29908 tablet_bootstrap.cc:654] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:08.418967 29909 tablet_bootstrap.cc:654] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:08.419138 29910 tablet_bootstrap.cc:492] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b: Bootstrap starting.
I20260928 20:15:08.419392 29908 log.cc:824] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:08.419574 29909 log.cc:824] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:08.419768 29910 tablet_bootstrap.cc:654] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:08.420228 29908 tablet_bootstrap.cc:492] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: No bootstrap required, opened a new log
I20260928 20:15:08.420306 29909 tablet_bootstrap.cc:492] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: No bootstrap required, opened a new log
I20260928 20:15:08.420301 29908 ts_tablet_manager.cc:1397] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:15:08.420346 29910 log.cc:824] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:08.420373 29909 ts_tablet_manager.cc:1397] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:08.421096 29910 tablet_bootstrap.cc:492] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b: No bootstrap required, opened a new log
I20260928 20:15:08.421164 29910 ts_tablet_manager.cc:1397] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:15:08.422353 29909 raft_consensus.cc:348] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.422322 29908 raft_consensus.cc:348] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.422498 29909 raft_consensus.cc:374] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:08.422498 29908 raft_consensus.cc:374] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:08.422533 29909 raft_consensus.cc:729] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5e6379e04cc48f19fc9fc139be3ecbd, State: Initialized, Role: FOLLOWER
I20260928 20:15:08.422533 29908 raft_consensus.cc:729] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d4653c2c0d41388b9e37a2becad986, State: Initialized, Role: FOLLOWER
I20260928 20:15:08.422650 29908 consensus_queue.cc:260] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.422663 29909 consensus_queue.cc:260] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.422947 29758 heartbeater.cc:503] Master 127.24.190.62:36565 was elected leader, sending a full tablet report...
I20260928 20:15:08.422986 29909 ts_tablet_manager.cc:1428] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:15:08.423022 29891 heartbeater.cc:503] Master 127.24.190.62:36565 was elected leader, sending a full tablet report...
I20260928 20:15:08.422940 29908 ts_tablet_manager.cc:1428] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:15:08.422848 29910 raft_consensus.cc:348] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.423323 29910 raft_consensus.cc:374] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:08.423379 29910 raft_consensus.cc:729] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 963cd091886a4a53bbda95ccaae3e30b, State: Initialized, Role: FOLLOWER
I20260928 20:15:08.423487 29910 consensus_queue.cc:260] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.423763 29910 ts_tablet_manager.cc:1428] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:15:08.423796 29625 heartbeater.cc:503] Master 127.24.190.62:36565 was elected leader, sending a full tablet report...
I20260928 20:15:08.449999 29915 raft_consensus.cc:482] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:08.450124 29915 raft_consensus.cc:504] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.450596 29915 leader_election.cc:288] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 963cd091886a4a53bbda95ccaae3e30b (127.24.190.1:35211), 87d4653c2c0d41388b9e37a2becad986 (127.24.190.2:37951)
I20260928 20:15:08.453537 29907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.450831 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:56905 (local address 127.24.190.1:35211)
0928 20:15:08.450878 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.450880 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.450893 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:15:08.450923 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.450924 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.450934 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.451011 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:08.451267 (+ 256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.451796 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.452762 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.453181 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.453236 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.453242 (+ 6us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.453421 (+ 179us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.453460 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:15:08.453519 29893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.450755 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:35211 (local address 127.24.190.3:56905)
0928 20:15:08.450810 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.450823 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.450868 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.451036 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.451037 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.451039 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:08.451121 (+ 82us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.451124 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.451873 (+ 749us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.451874 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.452669 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.452671 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.453262 (+ 591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.453263 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.453345 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.453348 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.453408 (+ 60us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.453437 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 20:15:08.453642 29905 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.450905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:45179 (local address 127.24.190.2:37951)
0928 20:15:08.450942 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.450944 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.451043 (+ 99us) server_negotiation.cc:407] Connection header received
0928 20:15:08.451076 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.451077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.451086 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.451148 (+ 62us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:08.451397 (+ 249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.451915 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.452884 (+ 969us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.453265 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.453345 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.453353 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.453526 (+ 173us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.453570 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 20:15:08.453644 29917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.450773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:37951 (local address 127.24.190.3:45179)
0928 20:15:08.450965 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.450975 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.451030 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.451242 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.451243 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.451245 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:08.451316 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.451318 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.451993 (+ 675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.451993 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.452796 (+ 803us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:08.452798 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.453351 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.453352 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:08.453442 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.453446 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.453503 (+ 57us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.453537 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":112,"threads_started":1}
I20260928 20:15:08.453950 29579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a16ffeaf79f49adab0a5418b03b539f" candidate_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963cd091886a4a53bbda95ccaae3e30b" is_pre_election: true
I20260928 20:15:08.453996 29712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a16ffeaf79f49adab0a5418b03b539f" candidate_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d4653c2c0d41388b9e37a2becad986" is_pre_election: true
I20260928 20:15:08.454113 29712 raft_consensus.cc:2454] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5e6379e04cc48f19fc9fc139be3ecbd in term 0.
I20260928 20:15:08.454113 29579 raft_consensus.cc:2454] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d5e6379e04cc48f19fc9fc139be3ecbd in term 0.
I20260928 20:15:08.454439 29780 leader_election.cc:302] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d4653c2c0d41388b9e37a2becad986, d5e6379e04cc48f19fc9fc139be3ecbd; no voters:
I20260928 20:15:08.454578 29915 raft_consensus.cc:2781] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:08.454632 29915 raft_consensus.cc:482] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:08.454655 29915 raft_consensus.cc:3037] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:08.455520 29915 raft_consensus.cc:504] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.455667 29915 leader_election.cc:288] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [CANDIDATE]: Term 1 election: Requested vote from peers 963cd091886a4a53bbda95ccaae3e30b (127.24.190.1:35211), 87d4653c2c0d41388b9e37a2becad986 (127.24.190.2:37951)
I20260928 20:15:08.455809 29579 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a16ffeaf79f49adab0a5418b03b539f" candidate_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "963cd091886a4a53bbda95ccaae3e30b"
I20260928 20:15:08.455894 29579 raft_consensus.cc:3037] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:08.456586 29579 raft_consensus.cc:2454] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5e6379e04cc48f19fc9fc139be3ecbd in term 1.
I20260928 20:15:08.456712 29712 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a16ffeaf79f49adab0a5418b03b539f" candidate_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d4653c2c0d41388b9e37a2becad986"
I20260928 20:15:08.456796 29712 raft_consensus.cc:3037] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:08.456833 29781 leader_election.cc:302] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 963cd091886a4a53bbda95ccaae3e30b, d5e6379e04cc48f19fc9fc139be3ecbd; no voters:
I20260928 20:15:08.457458 29712 raft_consensus.cc:2454] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d5e6379e04cc48f19fc9fc139be3ecbd in term 1.
I20260928 20:15:08.457535 29915 raft_consensus.cc:2781] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:08.457726 29915 raft_consensus.cc:686] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 1 LEADER]: Becoming Leader. State: Replica: d5e6379e04cc48f19fc9fc139be3ecbd, State: Running, Role: LEADER
I20260928 20:15:08.457826 29915 consensus_queue.cc:237] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } }
I20260928 20:15:08.458683 29433 catalog_manager.cc:5495] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd reported cstate change: term changed from 0 to 1, leader changed from <none> to d5e6379e04cc48f19fc9fc139be3ecbd (127.24.190.3). New cstate: current_term: 1 leader_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5e6379e04cc48f19fc9fc139be3ecbd" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37445 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:08.471923 29904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.469344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39836 (local address 127.24.190.3:37445)
0928 20:15:08.469404 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.469406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.469426 (+ 20us) server_negotiation.cc:407] Connection header received
0928 20:15:08.469483 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.469483 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.469519 (+ 36us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.469589 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:08.469766 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.470225 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.471144 (+ 919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:08.471321 (+ 177us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:08.471402 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:08.471567 (+ 165us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:08.471674 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:08.471743 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.471827 (+ 84us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.471847 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 20:15:08.473740 29712 raft_consensus.cc:1261] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 1 FOLLOWER]: Refusing update from remote peer d5e6379e04cc48f19fc9fc139be3ecbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:08.473768 29579 raft_consensus.cc:1261] T 1a16ffeaf79f49adab0a5418b03b539f P 963cd091886a4a53bbda95ccaae3e30b [term 1 FOLLOWER]: Refusing update from remote peer d5e6379e04cc48f19fc9fc139be3ecbd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:08.474097 29915 consensus_queue.cc:1035] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d4653c2c0d41388b9e37a2becad986" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37951 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:15:08.474231 29759 tablet.cc:2369] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:08.474225 29918 consensus_queue.cc:1035] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [LEADER]: Connected to new peer: Peer: permanent_uuid: "963cd091886a4a53bbda95ccaae3e30b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:08.476480 29921 mvcc.cc:205] Tried to move back new op lower bound from 7334406178705911808 to 7334406178644107264. Current Snapshot: MvccSnapshot[applied={T|T < 7334406178705911808}]
I20260928 20:15:08.476824 29923 mvcc.cc:205] Tried to move back new op lower bound from 7334406178705911808 to 7334406178644107264. Current Snapshot: MvccSnapshot[applied={T|T < 7334406178705911808}]
I20260928 20:15:08.477202 29922 mvcc.cc:205] Tried to move back new op lower bound from 7334406178705911808 to 7334406178644107264. Current Snapshot: MvccSnapshot[applied={T|T < 7334406178705911808 or (T in {7334406178705911808})}]
I20260928 20:15:08.479387 29434 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:08.479470 29434 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53404:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:08.480181 29434 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57f9ee4c65d64b2aaa8a736b9b1a226e: Sending DeleteTablet for 3 replicas of tablet 1a16ffeaf79f49adab0a5418b03b539f
I20260928 20:15:08.480585 29692 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a16ffeaf79f49adab0a5418b03b539f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:08 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:45326
I20260928 20:15:08.480602 29559 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a16ffeaf79f49adab0a5418b03b539f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:08 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:37162
I20260928 20:15:08.480587 29825 tablet_service.cc:1514] Processing DeleteTablet for tablet 1a16ffeaf79f49adab0a5418b03b539f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:08 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:39822
I20260928 20:15:08.480913 29931 tablet_replica.cc:330] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: stopping tablet replica
I20260928 20:15:08.481092 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29497
I20260928 20:15:08.481032 29931 raft_consensus.cc:2229] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:08.482900 29931 raft_consensus.cc:2258] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:08.483095 29933 tablet_replica.cc:330] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: stopping tablet replica
I20260928 20:15:08.483194 29933 raft_consensus.cc:2229] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:08.483326 29933 raft_consensus.cc:2258] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:08.483644 29931 ts_tablet_manager.cc:1905] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:08.483713 29933 ts_tablet_manager.cc:1905] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:08.485517 29933 ts_tablet_manager.cc:1918] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:08.485595 29933 log.cc:1196] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/1a16ffeaf79f49adab0a5418b03b539f
I20260928 20:15:08.485751 29931 ts_tablet_manager.cc:1918] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:08.485872 29931 log.cc:1196] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/1a16ffeaf79f49adab0a5418b03b539f
I20260928 20:15:08.485877 29933 ts_tablet_manager.cc:1939] T 1a16ffeaf79f49adab0a5418b03b539f P d5e6379e04cc48f19fc9fc139be3ecbd: Deleting consensus metadata
I20260928 20:15:08.486207 29931 ts_tablet_manager.cc:1939] T 1a16ffeaf79f49adab0a5418b03b539f P 87d4653c2c0d41388b9e37a2becad986: Deleting consensus metadata
I20260928 20:15:08.486307 29422 catalog_manager.cc:4841] TS d5e6379e04cc48f19fc9fc139be3ecbd (127.24.190.3:37445): tablet 1a16ffeaf79f49adab0a5418b03b539f (table test-table [id=9c64d897d25d40dba849eda6a8238bb0]) successfully deleted
I20260928 20:15:08.486732 29421 catalog_manager.cc:4841] TS 87d4653c2c0d41388b9e37a2becad986 (127.24.190.2:37951): tablet 1a16ffeaf79f49adab0a5418b03b539f (table test-table [id=9c64d897d25d40dba849eda6a8238bb0]) successfully deleted
W20260928 20:15:08.487370 29422 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:35211 (error 108)
I20260928 20:15:08.487550 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29630
I20260928 20:15:08.488584 29906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.488438 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:35211 (local address 127.0.0.1:37166)
0928 20:15:08.488501 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.488544 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:35211: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260928 20:15:08.488727 29422 catalog_manager.cc:4584] TS 963cd091886a4a53bbda95ccaae3e30b (127.24.190.1:35211): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1a16ffeaf79f49adab0a5418b03b539f: Network error: Client connection negotiation failed: client connection to 127.24.190.1:35211: connect: Connection refused (error 111)
I20260928 20:15:08.493055 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29763
I20260928 20:15:08.497468 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29404
2026-09-28T20:15:08Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (1994 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-09-28T20:15:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:08Z Disabled control of system clock
I20260928 20:15:08.524560 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:34295
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:34295
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 20:15:08.604859 29938 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.605059 29938 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.605080 29938 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.606166 29938 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:08.606201 29938 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.606215 29938 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.606227 29938 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:08.606240 29938 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:08.607602 29938 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:34295
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:34295
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.29938
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.607790 29938 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.608033 29938 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.612905 29946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.612924 29944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.613070 29938 server_base.cc:1034] running on GCE node
W20260928 20:15:08.612962 29943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.613423 29938 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.613732 29938 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.614923 29938 hybrid_clock.cc:648] HybridClock initialized: now 1790626508614880 us; error 58 us; skew 500 ppm
I20260928 20:15:08.616173 29938 webserver.cc:460] Webserver started at http://127.24.190.62:42515/ using document root <none> and password file <none>
I20260928 20:15:08.616426 29938 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.616495 29938 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.616644 29938 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.617715 29938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "dca8ad8a19f24fd1b091daf669ac9c2b"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "90ca21245a9896d891fbe69c9633398e"
server_key_iv: "849c9af78c00be3d2e59caf62a9c9d4d"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.618088 29938 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "dca8ad8a19f24fd1b091daf669ac9c2b"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "90ca21245a9896d891fbe69c9633398e"
server_key_iv: "849c9af78c00be3d2e59caf62a9c9d4d"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.619508 29938 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:08.620307 29952 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.620487 29938 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:08.620586 29938 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "dca8ad8a19f24fd1b091daf669ac9c2b"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "90ca21245a9896d891fbe69c9633398e"
server_key_iv: "849c9af78c00be3d2e59caf62a9c9d4d"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.620673 29938 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:08.624037 29938 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:08.624312 29938 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:08.624457 29938 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:08.628218 29938 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:34295
I20260928 20:15:08.628266 30004 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:34295 every 8 connection(s)
I20260928 20:15:08.628652 29938 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:08.629272 30005 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:08.632501 30005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b: Bootstrap starting.
I20260928 20:15:08.633088 30005 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:08.633380 30005 log.cc:824] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:08.634122 30005 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b: No bootstrap required, opened a new log
I20260928 20:15:08.635780 30005 raft_consensus.cc:348] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34295 } }
I20260928 20:15:08.635921 30005 raft_consensus.cc:374] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:08.635942 30005 raft_consensus.cc:729] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: dca8ad8a19f24fd1b091daf669ac9c2b, State: Initialized, Role: FOLLOWER
I20260928 20:15:08.636111 30005 consensus_queue.cc:260] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34295 } }
I20260928 20:15:08.636173 30005 raft_consensus.cc:388] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:08.636193 30005 raft_consensus.cc:482] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:08.636261 30005 raft_consensus.cc:3037] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:08.636808 30005 raft_consensus.cc:504] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34295 } }
I20260928 20:15:08.636919 30005 leader_election.cc:302] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: dca8ad8a19f24fd1b091daf669ac9c2b; no voters:
I20260928 20:15:08.637100 30005 leader_election.cc:288] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:08.637152 30008 raft_consensus.cc:2781] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:08.637358 30005 sys_catalog.cc:564] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:08.637379 30008 raft_consensus.cc:686] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [term 1 LEADER]: Becoming Leader. State: Replica: dca8ad8a19f24fd1b091daf669ac9c2b, State: Running, Role: LEADER
I20260928 20:15:08.637459 30008 consensus_queue.cc:237] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34295 } }
I20260928 20:15:08.637885 30010 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [sys.catalog]: SysCatalogTable state changed. Reason: New leader dca8ad8a19f24fd1b091daf669ac9c2b. Latest consensus state: current_term: 1 leader_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34295 } } }
I20260928 20:15:08.637969 30010 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:08.638108 30009 sys_catalog.cc:455] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "dca8ad8a19f24fd1b091daf669ac9c2b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34295 } } }
I20260928 20:15:08.638198 30009 sys_catalog.cc:458] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:08.638199 30017 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:08.638796 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 29938
I20260928 20:15:08.638916 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:08.639088 25336 external_mini_cluster.cc:1428] Setting key bae00b0e70b2bcf2bbd1ccb6bc1913a4
I20260928 20:15:08.639568 30017 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:08.643627 30017 catalog_manager.cc:1347] Generated new cluster ID: 692d1ec6aff743bbbd83ab7f1cc20c70
I20260928 20:15:08.643705 30017 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:08.644915 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.639660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40084 (local address 127.24.190.62:34295)
0928 20:15:08.642875 (+ 3215us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.642885 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.642926 (+ 41us) server_negotiation.cc:407] Connection header received
0928 20:15:08.643049 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.643055 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.643101 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.643251 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.644441 (+ 1190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.644445 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.644446 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:08.644452 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.644502 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:08.644515 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.644591 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.644656 (+ 65us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.644721 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3096,"thread_start_us":75,"threads_started":1}
I20260928 20:15:08.655378 30017 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:08.655606 30017 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:08.662792 30017 catalog_manager.cc:5868] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b: Generated new TSK 0
I20260928 20:15:08.663007 30017 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:15:08.672230 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34295
--builtin_ntp_servers=127.24.190.20:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 20:15:08.754246 30029 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.754535 30029 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.754560 30029 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.755780 30029 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.755825 30029 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.755854 30029 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:08.757253 30029 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30029
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.757534 30029 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.757858 30029 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.763088 30034 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.763103 30035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.763103 30037 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.763432 30029 server_base.cc:1034] running on GCE node
I20260928 20:15:08.763648 30029 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.763931 30029 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.765100 30029 hybrid_clock.cc:648] HybridClock initialized: now 1790626508765076 us; error 39 us; skew 500 ppm
I20260928 20:15:08.766505 30029 webserver.cc:460] Webserver started at http://127.24.190.1:43551/ using document root <none> and password file <none>
I20260928 20:15:08.766781 30029 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.766892 30029 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.767035 30029 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.768123 30029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "d747e125940cfac9183474805f569676"
server_key_iv: "6d6db03d19ef68a7759c26ddf6352bf8"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.768512 30029 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "d747e125940cfac9183474805f569676"
server_key_iv: "6d6db03d19ef68a7759c26ddf6352bf8"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.769879 30029 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:08.770663 30043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.770829 30029 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.770955 30029 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "d747e125940cfac9183474805f569676"
server_key_iv: "6d6db03d19ef68a7759c26ddf6352bf8"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.771032 30029 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:08.774451 30029 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:08.774721 30029 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:08.774871 30029 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:08.775087 30029 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:08.775401 30029 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:08.775456 30029 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.775496 30029 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:08.775523 30029 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.781265 30029 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:43935
I20260928 20:15:08.781361 30156 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:43935 every 8 connection(s)
I20260928 20:15:08.781679 30029 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:08.784811 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.782475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:51631 (local address 127.24.190.62:34295)
0928 20:15:08.782532 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.782534 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.782811 (+ 277us) server_negotiation.cc:407] Connection header received
0928 20:15:08.783339 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.783341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.783349 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.783402 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.784545 (+ 1143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.784546 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.784546 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:08.784551 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.784568 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:08.784572 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.784630 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.784724 (+ 94us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.784740 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 20:15:08.785043 30159 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.782489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34295 (local address 127.24.190.1:51631)
0928 20:15:08.782689 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.782722 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.783220 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.783488 (+ 268us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.783491 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.783499 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:08.784396 (+ 897us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:08.784396 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:08.784424 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:08.784451 (+ 27us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:08.784636 (+ 185us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:08.784641 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:08.784644 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.784741 (+ 97us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.784806 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":98,"threads_started":1}
I20260928 20:15:08.785539 30157 heartbeater.cc:347] Connected to a master server at 127.24.190.62:34295
I20260928 20:15:08.785614 30157 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:08.785797 30157 heartbeater.cc:511] Master 127.24.190.62:34295 requested a full tablet report, sending...
I20260928 20:15:08.786412 29969 ts_manager.cc:194] Registered new tserver with Master: e5b84a7b70ef4370be08fcf4e5ca7ca6 (127.24.190.1:43935)
I20260928 20:15:08.787106 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30029
I20260928 20:15:08.787195 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:08.787361 25336 external_mini_cluster.cc:1428] Setting key fd6dcb0fbe26d0e3321e5eaa757cbc5c
I20260928 20:15:08.788190 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34295
--builtin_ntp_servers=127.24.190.20:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 20:15:08.867226 30160 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.867470 30160 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.867504 30160 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.868637 30160 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.868706 30160 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.868749 30160 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:08.870092 30160 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30160
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.870391 30160 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.870687 30160 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.875761 30165 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.875809 30168 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.875823 30166 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.875919 30160 server_base.cc:1034] running on GCE node
I20260928 20:15:08.876224 30160 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.876431 30160 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.877571 30160 hybrid_clock.cc:648] HybridClock initialized: now 1790626508877555 us; error 32 us; skew 500 ppm
I20260928 20:15:08.878928 30160 webserver.cc:460] Webserver started at http://127.24.190.2:39799/ using document root <none> and password file <none>
I20260928 20:15:08.879184 30160 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.879256 30160 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.879413 30160 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.880523 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "02a112b501824d9e99412b2e9a671d1f"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "7b86b999308fa52de0aeb0241240c545"
server_key_iv: "fda4a8ac302a645ebc4e475655fc9b56"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.880895 30160 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "02a112b501824d9e99412b2e9a671d1f"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "7b86b999308fa52de0aeb0241240c545"
server_key_iv: "fda4a8ac302a645ebc4e475655fc9b56"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.882177 30160 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:08.882933 30174 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.883105 30160 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:08.883201 30160 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "02a112b501824d9e99412b2e9a671d1f"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "7b86b999308fa52de0aeb0241240c545"
server_key_iv: "fda4a8ac302a645ebc4e475655fc9b56"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.883282 30160 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:08.886610 30160 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:08.886873 30160 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:08.887014 30160 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:08.887218 30160 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:08.887522 30160 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:08.887575 30160 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.887614 30160 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:08.887643 30160 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:08.893460 30160 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:33809
I20260928 20:15:08.893496 30287 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:33809 every 8 connection(s)
I20260928 20:15:08.893890 30160 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:08.896914 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.894664 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38959 (local address 127.24.190.62:34295)
0928 20:15:08.894712 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:08.894714 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:08.894919 (+ 205us) server_negotiation.cc:407] Connection header received
0928 20:15:08.895420 (+ 501us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:08.895422 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:08.895429 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:08.895487 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:08.896634 (+ 1147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:08.896636 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:08.896637 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:08.896643 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:08.896660 (+ 17us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:08.896665 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:08.896744 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:08.896814 (+ 70us) server_negotiation.cc:299] Negotiation successful
0928 20:15:08.896829 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:15:08.897097 30290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:08.894624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34295 (local address 127.24.190.2:38959)
0928 20:15:08.894785 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:08.894826 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:08.895298 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:08.895557 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:08.895560 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:08.895570 (+ 10us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:08.896479 (+ 909us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:08.896479 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:08.896506 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:08.896534 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:08.896744 (+ 210us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:08.896751 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:08.896753 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:15:08.896827 (+ 74us) client_negotiation.cc:240] Negotiation successful
0928 20:15:08.896888 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":68,"threads_started":1}
I20260928 20:15:08.897575 30288 heartbeater.cc:347] Connected to a master server at 127.24.190.62:34295
I20260928 20:15:08.897686 30288 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:08.897840 30288 heartbeater.cc:511] Master 127.24.190.62:34295 requested a full tablet report, sending...
I20260928 20:15:08.898236 29969 ts_manager.cc:194] Registered new tserver with Master: 02a112b501824d9e99412b2e9a671d1f (127.24.190.2:33809)
I20260928 20:15:08.902585 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30160
I20260928 20:15:08.902668 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:08.902810 25336 external_mini_cluster.cc:1428] Setting key 51ac93b31aa58f07ca849a0e386aef6f
I20260928 20:15:08.903731 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34295
--builtin_ntp_servers=127.24.190.20:43515
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260928 20:15:08.984424 30291 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:08.984622 30291 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:08.984644 30291 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:08.985831 30291 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:08.985868 30291 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:08.985893 30291 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:08.987298 30291 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43515
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34295
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30291
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:08.987483 30291 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:08.987718 30291 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:08.992652 30297 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.992689 30299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:08.992662 30296 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:08.992791 30291 server_base.cc:1034] running on GCE node
I20260928 20:15:08.993119 30291 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:08.993355 30291 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:08.994524 30291 hybrid_clock.cc:648] HybridClock initialized: now 1790626508994513 us; error 37 us; skew 500 ppm
I20260928 20:15:08.995854 30291 webserver.cc:460] Webserver started at http://127.24.190.3:40857/ using document root <none> and password file <none>
I20260928 20:15:08.996106 30291 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:08.996179 30291 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:08.996338 30291 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:08.997442 30291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "9e8ac93c67344092ac68a45ba10c25bb"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "c991a56c7cd8a7634b37326e7698f42a"
server_key_iv: "85ed7d5990b1c5d64d044d25c5293b38"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.997800 30291 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "9e8ac93c67344092ac68a45ba10c25bb"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "c991a56c7cd8a7634b37326e7698f42a"
server_key_iv: "85ed7d5990b1c5d64d044d25c5293b38"
server_key_version: "encryptionkey@0"
I20260928 20:15:08.999310 30291 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:08.999990 30305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.000162 30291 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:09.000268 30291 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "9e8ac93c67344092ac68a45ba10c25bb"
format_stamp: "Formatted at 2026-09-28 20:15:08 on dist-test-slave-n45k"
server_key: "c991a56c7cd8a7634b37326e7698f42a"
server_key_iv: "85ed7d5990b1c5d64d044d25c5293b38"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.000342 30291 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:09.003814 30291 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:09.004068 30291 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:09.004204 30291 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:09.004422 30291 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:09.004727 30291 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:09.004783 30291 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.004822 30291 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:09.004848 30291 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.010674 30291 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:44439
I20260928 20:15:09.010712 30418 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:44439 every 8 connection(s)
I20260928 20:15:09.011029 30291 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:09.014590 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.012928 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:44249 (local address 127.24.190.62:34295)
0928 20:15:09.012967 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.012969 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.012976 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:15:09.013003 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.013004 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.013009 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.013091 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.014289 (+ 1198us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.014290 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.014291 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.014296 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.014316 (+ 20us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.014321 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.014407 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.014502 (+ 95us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.014519 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:15:09.014779 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.011799 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34295 (local address 127.24.190.3:44249)
0928 20:15:09.011994 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.012040 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.012729 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.013174 (+ 445us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.013184 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.013193 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:09.014115 (+ 922us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:09.014115 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:09.014142 (+ 27us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:09.014168 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:09.014402 (+ 234us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:09.014407 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:09.014411 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:09.014510 (+ 99us) client_negotiation.cc:240] Negotiation successful
0928 20:15:09.014570 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":64,"threads_started":1}
I20260928 20:15:09.015265 30419 heartbeater.cc:347] Connected to a master server at 127.24.190.62:34295
I20260928 20:15:09.015347 30419 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:09.015450 30419 heartbeater.cc:511] Master 127.24.190.62:34295 requested a full tablet report, sending...
I20260928 20:15:09.015800 29969 ts_manager.cc:194] Registered new tserver with Master: 9e8ac93c67344092ac68a45ba10c25bb (127.24.190.3:44439)
I20260928 20:15:09.018702 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30291
I20260928 20:15:09.018910 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:09.019125 25336 external_mini_cluster.cc:1428] Setting key e3bb8f4656f28d49611d18445cb2de00
I20260928 20:15:09.019918 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:15:09.022240 30027 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.021292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40092 (local address 127.24.190.62:34295)
0928 20:15:09.021349 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.021351 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.021451 (+ 100us) server_negotiation.cc:407] Connection header received
0928 20:15:09.021498 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.021498 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.021502 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.021552 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.022073 (+ 521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.022074 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.022074 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.022077 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.022092 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.022096 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.022146 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.022180 (+ 34us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.022191 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:15:09.023844 29969 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:40092:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:09.025307 29969 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:09.029526 30431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.027556 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:44439 (local address 127.0.0.1:40522)
0928 20:15:09.027897 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.027909 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.027963 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.028477 (+ 514us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.028484 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.028491 (+ 7us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:09.029083 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:09.029083 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:09.029099 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:09.029125 (+ 26us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:09.029370 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:09.029375 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:09.029378 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:09.029442 (+ 64us) client_negotiation.cc:240] Negotiation successful
0928 20:15:09.029456 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":58,"threads_started":1}
I20260928 20:15:09.029537 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.027658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40522 (local address 127.24.190.3:44439)
0928 20:15:09.027818 (+ 160us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.027824 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.028025 (+ 201us) server_negotiation.cc:407] Connection header received
0928 20:15:09.028054 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.028057 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.028068 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.028137 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.029211 (+ 1074us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.029219 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.029220 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.029225 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.029271 (+ 46us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.029293 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.029355 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.029446 (+ 91us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.029461 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":72,"threads_started":1}
I20260928 20:15:09.029883 30432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.028022 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37700 (local address 127.24.190.1:43935)
0928 20:15:09.028348 (+ 326us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.028351 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.028360 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:09.028383 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.028385 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.028392 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.028470 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.029563 (+ 1093us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.029569 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.029570 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.029574 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.029610 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.029645 (+ 35us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.029700 (+ 55us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.029779 (+ 79us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.029796 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":293,"thread_start_us":211,"threads_started":1}
I20260928 20:15:09.030289 30429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.027554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33809 (local address 127.0.0.1:40488)
0928 20:15:09.027786 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.027826 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.027878 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.028651 (+ 773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.028652 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.028655 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:09.029231 (+ 576us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:09.029231 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:09.029237 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:09.029284 (+ 47us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:09.030129 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:09.030130 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:09.030131 (+ 1us) client_negotiation.cc:769] Sending connection context
0928 20:15:09.030181 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:15:09.030194 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":199,"spinlock_wait_cycles":384,"thread_start_us":154,"threads_started":1}
I20260928 20:15:09.030315 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.027625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40488 (local address 127.24.190.2:33809)
0928 20:15:09.028211 (+ 586us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.028216 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.028227 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:15:09.028254 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.028256 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.028265 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.028344 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.029857 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.029864 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.029864 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.029871 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.029907 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.029923 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.030103 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.030200 (+ 97us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.030217 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":476,"thread_start_us":73,"threads_started":1}
I20260928 20:15:09.030551 30427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.027769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:43935 (local address 127.0.0.1:37700)
0928 20:15:09.027982 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.027993 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.028025 (+ 32us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.028482 (+ 457us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.028485 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.028491 (+ 6us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:09.029467 (+ 976us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:09.029468 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:09.029474 (+ 6us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:09.029485 (+ 11us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:09.029707 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:09.029708 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:09.029708 (+ 0us) client_negotiation.cc:769] Sending connection context
0928 20:15:09.029769 (+ 61us) client_negotiation.cc:240] Negotiation successful
0928 20:15:09.029783 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":81,"threads_started":1}
I20260928 20:15:09.030539 30353 tablet_service.cc:1467] Processing CreateTablet for tablet 5d096d32d568494994ad2e1b3a3b58a7 (DEFAULT_TABLE table=test-table [id=cad247d67dc34a11a5210f4bfab0e504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:09.030936 30353 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d096d32d568494994ad2e1b3a3b58a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:09.031334 30091 tablet_service.cc:1467] Processing CreateTablet for tablet 5d096d32d568494994ad2e1b3a3b58a7 (DEFAULT_TABLE table=test-table [id=cad247d67dc34a11a5210f4bfab0e504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:09.031643 30091 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d096d32d568494994ad2e1b3a3b58a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:09.033706 30433 tablet_bootstrap.cc:492] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Bootstrap starting.
I20260928 20:15:09.034329 30434 tablet_bootstrap.cc:492] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6: Bootstrap starting.
I20260928 20:15:09.034395 30433 tablet_bootstrap.cc:654] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:09.034426 30222 tablet_service.cc:1467] Processing CreateTablet for tablet 5d096d32d568494994ad2e1b3a3b58a7 (DEFAULT_TABLE table=test-table [id=cad247d67dc34a11a5210f4bfab0e504]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:09.034720 30433 log.cc:824] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:09.034759 30222 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5d096d32d568494994ad2e1b3a3b58a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:09.035122 30434 tablet_bootstrap.cc:654] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:09.035462 30434 log.cc:824] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:09.035634 30433 tablet_bootstrap.cc:492] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: No bootstrap required, opened a new log
I20260928 20:15:09.035708 30433 ts_tablet_manager.cc:1397] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:15:09.036230 30434 tablet_bootstrap.cc:492] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6: No bootstrap required, opened a new log
I20260928 20:15:09.036322 30434 ts_tablet_manager.cc:1397] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:15:09.038019 30437 tablet_bootstrap.cc:492] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Bootstrap starting.
I20260928 20:15:09.038441 30433 raft_consensus.cc:348] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.038600 30433 raft_consensus.cc:374] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:09.038511 30434 raft_consensus.cc:348] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.038651 30433 raft_consensus.cc:729] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e8ac93c67344092ac68a45ba10c25bb, State: Initialized, Role: FOLLOWER
I20260928 20:15:09.038676 30434 raft_consensus.cc:374] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:09.038726 30434 raft_consensus.cc:729] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5b84a7b70ef4370be08fcf4e5ca7ca6, State: Initialized, Role: FOLLOWER
I20260928 20:15:09.038765 30433 consensus_queue.cc:260] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.038918 30434 consensus_queue.cc:260] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.039040 30437 tablet_bootstrap.cc:654] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:09.039043 30433 ts_tablet_manager.cc:1428] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260928 20:15:09.039178 30419 heartbeater.cc:503] Master 127.24.190.62:34295 was elected leader, sending a full tablet report...
I20260928 20:15:09.039201 30434 ts_tablet_manager.cc:1428] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s
I20260928 20:15:09.039338 30157 heartbeater.cc:503] Master 127.24.190.62:34295 was elected leader, sending a full tablet report...
I20260928 20:15:09.039371 30437 log.cc:824] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:09.040244 30437 tablet_bootstrap.cc:492] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: No bootstrap required, opened a new log
I20260928 20:15:09.040307 30437 ts_tablet_manager.cc:1397] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:09.042070 30437 raft_consensus.cc:348] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.042191 30437 raft_consensus.cc:374] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:09.042212 30437 raft_consensus.cc:729] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 02a112b501824d9e99412b2e9a671d1f, State: Initialized, Role: FOLLOWER
I20260928 20:15:09.042367 30437 consensus_queue.cc:260] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.042624 30437 ts_tablet_manager.cc:1428] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:15:09.042654 30288 heartbeater.cc:503] Master 127.24.190.62:34295 was elected leader, sending a full tablet report...
I20260928 20:15:09.143401 30438 raft_consensus.cc:482] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:09.143564 30438 raft_consensus.cc:504] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.143980 30438 leader_election.cc:288] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 02a112b501824d9e99412b2e9a671d1f (127.24.190.2:33809), e5b84a7b70ef4370be08fcf4e5ca7ca6 (127.24.190.1:43935)
W20260928 20:15:09.144452 30289 tablet.cc:2369] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:09.145375 30428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.144223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:50503 (local address 127.24.190.2:33809)
0928 20:15:09.144274 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.144276 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.144286 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:09.144339 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.144340 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.144345 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.144408 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.145131 (+ 723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.145132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.145133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.145138 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.145157 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.145162 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.145229 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.145295 (+ 66us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.145308 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:15:09.145375 30421 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.144168 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33809 (local address 127.24.190.3:50503)
0928 20:15:09.144210 (+ 42us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.144224 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.144262 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.144426 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.144427 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.144430 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:09.145022 (+ 592us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:09.145022 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:09.145031 (+ 9us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:09.145045 (+ 14us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:09.145225 (+ 180us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:09.145225 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:09.145226 (+ 1us) client_negotiation.cc:769] Sending connection context
0928 20:15:09.145292 (+ 66us) client_negotiation.cc:240] Negotiation successful
0928 20:15:09.145308 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260928 20:15:09.145664 30242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d096d32d568494994ad2e1b3a3b58a7" candidate_uuid: "9e8ac93c67344092ac68a45ba10c25bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a112b501824d9e99412b2e9a671d1f" is_pre_election: true
I20260928 20:15:09.145824 30242 raft_consensus.cc:2454] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8ac93c67344092ac68a45ba10c25bb in term 0.
I20260928 20:15:09.145869 30432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.144256 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:43341 (local address 127.24.190.1:43935)
0928 20:15:09.144316 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.144319 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.144572 (+ 253us) server_negotiation.cc:407] Connection header received
0928 20:15:09.144704 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.144705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.144711 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.144764 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.145341 (+ 577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.145343 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.145343 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.145348 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.145364 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.145368 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.145422 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.145777 (+ 355us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.145792 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 20:15:09.145895 30442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.144172 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:43935 (local address 127.24.190.3:43341)
0928 20:15:09.144508 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.144520 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.144593 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.144814 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.144815 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.144818 (+ 3us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:09.145236 (+ 418us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:09.145237 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:09.145242 (+ 5us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:09.145251 (+ 9us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:09.145700 (+ 449us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:09.145701 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:09.145707 (+ 6us) client_negotiation.cc:769] Sending connection context
0928 20:15:09.145775 (+ 68us) client_negotiation.cc:240] Negotiation successful
0928 20:15:09.145790 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":317,"mutex_wait_us":170,"thread_start_us":115,"threads_started":1}
I20260928 20:15:09.146159 30309 leader_election.cc:302] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a112b501824d9e99412b2e9a671d1f, 9e8ac93c67344092ac68a45ba10c25bb; no voters:
I20260928 20:15:09.146253 30111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d096d32d568494994ad2e1b3a3b58a7" candidate_uuid: "9e8ac93c67344092ac68a45ba10c25bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" is_pre_election: true
I20260928 20:15:09.146360 30438 raft_consensus.cc:2781] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:09.146427 30111 raft_consensus.cc:2454] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e8ac93c67344092ac68a45ba10c25bb in term 0.
I20260928 20:15:09.146461 30438 raft_consensus.cc:482] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:09.146494 30438 raft_consensus.cc:3037] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:09.147403 30438 raft_consensus.cc:504] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.147620 30438 leader_election.cc:288] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [CANDIDATE]: Term 1 election: Requested vote from peers 02a112b501824d9e99412b2e9a671d1f (127.24.190.2:33809), e5b84a7b70ef4370be08fcf4e5ca7ca6 (127.24.190.1:43935)
I20260928 20:15:09.147733 30242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d096d32d568494994ad2e1b3a3b58a7" candidate_uuid: "9e8ac93c67344092ac68a45ba10c25bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "02a112b501824d9e99412b2e9a671d1f"
I20260928 20:15:09.147755 30111 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d096d32d568494994ad2e1b3a3b58a7" candidate_uuid: "9e8ac93c67344092ac68a45ba10c25bb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6"
I20260928 20:15:09.147833 30242 raft_consensus.cc:3037] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:09.147826 30111 raft_consensus.cc:3037] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:09.148538 30242 raft_consensus.cc:2454] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8ac93c67344092ac68a45ba10c25bb in term 1.
I20260928 20:15:09.148545 30111 raft_consensus.cc:2454] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e8ac93c67344092ac68a45ba10c25bb in term 1.
I20260928 20:15:09.148715 30309 leader_election.cc:302] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 02a112b501824d9e99412b2e9a671d1f, 9e8ac93c67344092ac68a45ba10c25bb; no voters:
I20260928 20:15:09.148861 30438 raft_consensus.cc:2781] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:09.148991 30438 raft_consensus.cc:686] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 1 LEADER]: Becoming Leader. State: Replica: 9e8ac93c67344092ac68a45ba10c25bb, State: Running, Role: LEADER
I20260928 20:15:09.149063 30438 consensus_queue.cc:237] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } }
I20260928 20:15:09.149976 29969 catalog_manager.cc:5495] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb reported cstate change: term changed from 0 to 1, leader changed from <none> to 9e8ac93c67344092ac68a45ba10c25bb (127.24.190.3). New cstate: current_term: 1 leader_uuid: "9e8ac93c67344092ac68a45ba10c25bb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e8ac93c67344092ac68a45ba10c25bb" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 44439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:09.175247 30430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.174148 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40536 (local address 127.24.190.3:44439)
0928 20:15:09.174211 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.174213 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.174259 (+ 46us) server_negotiation.cc:407] Connection header received
0928 20:15:09.174325 (+ 66us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.174326 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.174344 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.174417 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.174973 (+ 556us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.174975 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.174975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.174980 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.174996 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.175000 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.175072 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.175154 (+ 82us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.175168 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 20:15:09.177111 30111 raft_consensus.cc:1261] T 5d096d32d568494994ad2e1b3a3b58a7 P e5b84a7b70ef4370be08fcf4e5ca7ca6 [term 1 FOLLOWER]: Refusing update from remote peer 9e8ac93c67344092ac68a45ba10c25bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:09.177152 30242 raft_consensus.cc:1261] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 1 FOLLOWER]: Refusing update from remote peer 9e8ac93c67344092ac68a45ba10c25bb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:09.177482 30443 consensus_queue.cc:1035] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "02a112b501824d9e99412b2e9a671d1f" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:09.177603 30438 consensus_queue.cc:1035] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e5b84a7b70ef4370be08fcf4e5ca7ca6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43935 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:09.180028 30446 mvcc.cc:205] Tried to move back new op lower bound from 7334406181586604032 to 7334406181475508224. Current Snapshot: MvccSnapshot[applied={T|T < 7334406181586604032}]
I20260928 20:15:09.180748 30448 mvcc.cc:205] Tried to move back new op lower bound from 7334406181586604032 to 7334406181475508224. Current Snapshot: MvccSnapshot[applied={T|T < 7334406181586604032}]
I20260928 20:15:09.180824 30447 mvcc.cc:205] Tried to move back new op lower bound from 7334406181586604032 to 7334406181475508224. Current Snapshot: MvccSnapshot[applied={T|T < 7334406181586604032 or (T in {7334406181586604032})}]
I20260928 20:15:09.182627 29968 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:09.182735 29968 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40092:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:09.183516 29968 catalog_manager.cc:5782] T 00000000000000000000000000000000 P dca8ad8a19f24fd1b091daf669ac9c2b: Sending DeleteTablet for 3 replicas of tablet 5d096d32d568494994ad2e1b3a3b58a7
I20260928 20:15:09.183864 30222 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d096d32d568494994ad2e1b3a3b58a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:09 UTC) from {username='slave'} at 127.0.0.1:40488
I20260928 20:15:09.183894 30353 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d096d32d568494994ad2e1b3a3b58a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:09 UTC) from {username='slave'} at 127.0.0.1:40522
I20260928 20:15:09.184082 30456 tablet_replica.cc:330] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: stopping tablet replica
I20260928 20:15:09.184077 30091 tablet_service.cc:1514] Processing DeleteTablet for tablet 5d096d32d568494994ad2e1b3a3b58a7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:09 UTC) from {username='slave'} at 127.0.0.1:37700
I20260928 20:15:09.184175 30456 raft_consensus.cc:2229] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:09.184269 30457 tablet_replica.cc:330] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: stopping tablet replica
I20260928 20:15:09.184309 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30029
I20260928 20:15:09.184329 30456 raft_consensus.cc:2258] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:09.184376 30457 raft_consensus.cc:2229] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:09.184545 30457 raft_consensus.cc:2258] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:09.185832 30457 ts_tablet_manager.cc:1905] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:09.187376 30456 ts_tablet_manager.cc:1905] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:09.187839 30457 ts_tablet_manager.cc:1918] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:09.187916 30457 log.cc:1196] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/5d096d32d568494994ad2e1b3a3b58a7
I20260928 20:15:09.188156 30457 ts_tablet_manager.cc:1939] T 5d096d32d568494994ad2e1b3a3b58a7 P 02a112b501824d9e99412b2e9a671d1f: Deleting consensus metadata
I20260928 20:15:09.188657 29956 catalog_manager.cc:4841] TS 02a112b501824d9e99412b2e9a671d1f (127.24.190.2:33809): tablet 5d096d32d568494994ad2e1b3a3b58a7 (table test-table [id=cad247d67dc34a11a5210f4bfab0e504]) successfully deleted
I20260928 20:15:09.189019 30456 ts_tablet_manager.cc:1918] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:09.189095 30456 log.cc:1196] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/5d096d32d568494994ad2e1b3a3b58a7
I20260928 20:15:09.189371 30456 ts_tablet_manager.cc:1939] T 5d096d32d568494994ad2e1b3a3b58a7 P 9e8ac93c67344092ac68a45ba10c25bb: Deleting consensus metadata
I20260928 20:15:09.189842 29955 catalog_manager.cc:4841] TS 9e8ac93c67344092ac68a45ba10c25bb (127.24.190.3:44439): tablet 5d096d32d568494994ad2e1b3a3b58a7 (table test-table [id=cad247d67dc34a11a5210f4bfab0e504]) successfully deleted
W20260928 20:15:09.190465 29955 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:43935 (error 108)
I20260928 20:15:09.190989 30427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.190867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:43935 (local address 127.0.0.1:37702)
0928 20:15:09.190915 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.190956 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:43935: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260928 20:15:09.191030 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30160
W20260928 20:15:09.191129 29955 catalog_manager.cc:4584] TS e5b84a7b70ef4370be08fcf4e5ca7ca6 (127.24.190.1:43935): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 5d096d32d568494994ad2e1b3a3b58a7: Network error: Client connection negotiation failed: client connection to 127.24.190.1:43935: connect: Connection refused (error 111)
I20260928 20:15:09.195452 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30291
I20260928 20:15:09.199870 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 29938
2026-09-28T20:15:09Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (702 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260928 20:15:09.219758 25336 mini_oidc.cc:152] Starting JWKS server
I20260928 20:15:09.220849 25336 webserver.cc:460] Webserver started at https://127.0.0.1:33453/ using document root <none> and password file <none>
I20260928 20:15:09.220973 25336 mini_oidc.cc:189] Starting OIDC Discovery server
I20260928 20:15:09.221159 25336 webserver.cc:460] Webserver started at http://127.0.0.1:42663/ using document root <none> and password file <none>
2026-09-28T20:15:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:09Z Disabled control of system clock
I20260928 20:15:09.229063 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41079
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:44139
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41079
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33453/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/testchainca.cert with env {}
W20260928 20:15:09.309643 30465 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:09.309850 30465 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:09.309873 30465 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:09.310992 30465 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:09.311028 30465 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:09.311040 30465 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:09.311053 30465 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:09.311064 30465 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 20:15:09.311076 30465 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 20:15:09.311087 30465 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:33453/jwks.json
I20260928 20:15:09.312564 30465 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44139
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41079
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41079
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:33453/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:09.312762 30465 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:09.312928 30465 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:09.317787 30473 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:09.317862 30470 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:09.317787 30471 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.318137 30465 server_base.cc:1034] running on GCE node
I20260928 20:15:09.318428 30465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:09.318717 30465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:09.319881 30465 hybrid_clock.cc:648] HybridClock initialized: now 1790626509319871 us; error 28 us; skew 500 ppm
I20260928 20:15:09.321081 30465 webserver.cc:460] Webserver started at http://127.24.190.62:44105/ using document root <none> and password file <none>
I20260928 20:15:09.321329 30465 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:09.321442 30465 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:09.321592 30465 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:09.322744 30465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "1703caf764a24cd784e18693bc9ccc90"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "ecd5e539aa773bed9e4f35e996cf5f5d"
server_key_iv: "5f02c9567457832d2f0c60a76473e806"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.323097 30465 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "1703caf764a24cd784e18693bc9ccc90"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "ecd5e539aa773bed9e4f35e996cf5f5d"
server_key_iv: "5f02c9567457832d2f0c60a76473e806"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.324476 30465 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:09.325297 30479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.325479 30465 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:09.325588 30465 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "1703caf764a24cd784e18693bc9ccc90"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "ecd5e539aa773bed9e4f35e996cf5f5d"
server_key_iv: "5f02c9567457832d2f0c60a76473e806"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.325649 30465 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:09.345395 30465 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:09.345777 30465 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:09.345942 30465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:09.350069 30465 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:41079
I20260928 20:15:09.350096 30531 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:41079 every 8 connection(s)
I20260928 20:15:09.350521 30465 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:09.351562 30532 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:09.353250 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30465
I20260928 20:15:09.353367 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:09.353544 25336 external_mini_cluster.cc:1428] Setting key c6ffcf13805d11c7b4651fc3bce57577
I20260928 20:15:09.354655 30532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90: Bootstrap starting.
I20260928 20:15:09.355273 30532 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:09.355604 30532 log.cc:824] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:09.356369 30532 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90: No bootstrap required, opened a new log
I20260928 20:15:09.358943 30532 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1703caf764a24cd784e18693bc9ccc90" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41079 } }
I20260928 20:15:09.359136 30532 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:09.359185 30532 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1703caf764a24cd784e18693bc9ccc90, State: Initialized, Role: FOLLOWER
I20260928 20:15:09.359367 30532 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1703caf764a24cd784e18693bc9ccc90" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41079 } }
I20260928 20:15:09.359457 30532 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:09.359496 30532 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:09.359537 30532 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:09.359706 30535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.354131 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36502 (local address 127.24.190.62:41079)
0928 20:15:09.354396 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.354405 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.354431 (+ 26us) server_negotiation.cc:407] Connection header received
0928 20:15:09.354884 (+ 453us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.354891 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.354956 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.355107 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.355300 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.356445 (+ 1145us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.357622 (+ 1177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.358042 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.358145 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.358948 (+ 803us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.358952 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.358952 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.359143 (+ 191us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.359208 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.359224 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.359284 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.359370 (+ 86us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.359483 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":87,"threads_started":1}
I20260928 20:15:09.360306 30532 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1703caf764a24cd784e18693bc9ccc90" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41079 } }
I20260928 20:15:09.360436 30532 leader_election.cc:302] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1703caf764a24cd784e18693bc9ccc90; no voters:
I20260928 20:15:09.360611 30532 leader_election.cc:288] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:09.360702 30537 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:09.360705 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:15:09.360881 30532 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:09.360936 30537 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [term 1 LEADER]: Becoming Leader. State: Replica: 1703caf764a24cd784e18693bc9ccc90, State: Running, Role: LEADER
I20260928 20:15:09.361083 30537 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1703caf764a24cd784e18693bc9ccc90" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41079 } }
I20260928 20:15:09.361472 30538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1703caf764a24cd784e18693bc9ccc90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1703caf764a24cd784e18693bc9ccc90" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41079 } } }
I20260928 20:15:09.361555 30538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:09.361701 30538 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1703caf764a24cd784e18693bc9ccc90. Latest consensus state: current_term: 1 leader_uuid: "1703caf764a24cd784e18693bc9ccc90" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1703caf764a24cd784e18693bc9ccc90" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41079 } } }
I20260928 20:15:09.361752 30538 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:09.361923 30546 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:09.362447 30546 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:09.364132 30546 catalog_manager.cc:1347] Generated new cluster ID: 505eec6a4a3f42be89ab916728b1c95f
I20260928 20:15:09.364183 30546 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:09.379321 30546 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:09.380088 30546 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:09.394007 30546 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1703caf764a24cd784e18693bc9ccc90: Generated new TSK 0
I20260928 20:15:09.394251 30546 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260928 20:15:09.422497 30562 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260928 20:15:09.422613 30562 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260928 20:15:09.422875 30535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.407314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36516 (local address 127.24.190.62:41079)
0928 20:15:09.407386 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.407388 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.407556 (+ 168us) server_negotiation.cc:407] Connection header received
0928 20:15:09.407666 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.407666 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.407677 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.407738 (+ 61us) server_negotiation.cc:226] Negotiated authn=JWT
0928 20:15:09.407975 (+ 237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.408482 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.409649 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.409836 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.409888 (+ 52us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.410111 (+ 223us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 20:15:09.422650 (+ 12539us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0928 20:15:09.422821 (+ 171us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:36516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":44}
W20260928 20:15:09.422943 30535 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:36516: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260928 20:15:09.423427 30561 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:09.407253 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41079 (local address 127.0.0.1:36516)
0928 20:15:09.407477 (+ 224us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.407489 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.407567 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.407821 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.407822 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.407825 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0928 20:15:09.407903 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:09.407906 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.408588 (+ 682us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.408589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:09.409563 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:09.409566 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.409910 (+ 344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.409911 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:09.409979 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.410002 (+ 23us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 20:15:09.422813 (+ 12811us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0928 20:15:09.422957 (+ 144us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.190.62:41079: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":121,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.24.190.62:41079: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:33453/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260928 20:15:09.423892 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30465
2026-09-28T20:15:09Z chronyd exiting
I20260928 20:15:09.459738 25336 test_util.cc:175] -----------------------------------------------
I20260928 20:15:09.459821 25336 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1790626483051462-25336-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (240 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260928 20:15:09.460623 25336 mini_oidc.cc:152] Starting JWKS server
I20260928 20:15:09.461370 25336 webserver.cc:460] Webserver started at https://127.0.0.1:38973/ using document root <none> and password file <none>
I20260928 20:15:09.461413 25336 mini_oidc.cc:189] Starting OIDC Discovery server
I20260928 20:15:09.461591 25336 webserver.cc:460] Webserver started at http://127.0.0.1:45235/ using document root <none> and password file <none>
2026-09-28T20:15:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:09Z Disabled control of system clock
I20260928 20:15:09.469903 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46029
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:37351
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:46029
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38973/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/testchainca.cert with env {}
W20260928 20:15:09.550155 30568 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:09.550392 30568 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:09.550417 30568 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:09.551546 30568 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:09.551585 30568 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:09.551597 30568 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:09.551610 30568 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:09.551622 30568 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 20:15:09.551635 30568 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 20:15:09.551646 30568 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:38973/jwks.json
I20260928 20:15:09.553100 30568 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37351
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:46029
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46029
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:38973/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30568
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:09.553297 30568 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:09.553462 30568 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:09.558425 30576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:09.558480 30574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.558581 30568 server_base.cc:1034] running on GCE node
W20260928 20:15:09.558722 30573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.559036 30568 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:09.559373 30568 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:09.560551 30568 hybrid_clock.cc:648] HybridClock initialized: now 1790626509560539 us; error 49 us; skew 500 ppm
I20260928 20:15:09.561856 30568 webserver.cc:460] Webserver started at http://127.24.190.62:45349/ using document root <none> and password file <none>
I20260928 20:15:09.562096 30568 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:09.562165 30568 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:09.562342 30568 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:09.563419 30568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "cd381b90754e44d88a004ebc862f5372"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "48927e88a299c89ce07a2169840bb9fe"
server_key_iv: "2541bccf5fddb2a1ff13ccdc3c828e6c"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.563824 30568 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "cd381b90754e44d88a004ebc862f5372"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "48927e88a299c89ce07a2169840bb9fe"
server_key_iv: "2541bccf5fddb2a1ff13ccdc3c828e6c"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.565121 30568 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:09.565924 30582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.566128 30568 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:09.566226 30568 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "cd381b90754e44d88a004ebc862f5372"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "48927e88a299c89ce07a2169840bb9fe"
server_key_iv: "2541bccf5fddb2a1ff13ccdc3c828e6c"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.566334 30568 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:09.576315 30568 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:09.576637 30568 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:09.576802 30568 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:09.580886 30568 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:46029
I20260928 20:15:09.580920 30634 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:46029 every 8 connection(s)
I20260928 20:15:09.581260 30568 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:09.581907 30635 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:09.584250 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30568
I20260928 20:15:09.584367 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:09.584524 25336 external_mini_cluster.cc:1428] Setting key 62b854a288b3e2b6ca500b43ae2193d4
I20260928 20:15:09.585273 30635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372: Bootstrap starting.
I20260928 20:15:09.585872 30635 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:09.586210 30635 log.cc:824] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:09.587131 30635 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372: No bootstrap required, opened a new log
I20260928 20:15:09.589684 30635 raft_consensus.cc:348] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd381b90754e44d88a004ebc862f5372" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46029 } }
I20260928 20:15:09.589917 30635 raft_consensus.cc:374] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:09.589967 30635 raft_consensus.cc:729] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd381b90754e44d88a004ebc862f5372, State: Initialized, Role: FOLLOWER
I20260928 20:15:09.590106 30635 consensus_queue.cc:260] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd381b90754e44d88a004ebc862f5372" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46029 } }
I20260928 20:15:09.590171 30635 raft_consensus.cc:388] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:09.590199 30635 raft_consensus.cc:482] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:09.590292 30635 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:09.590881 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.585088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46548 (local address 127.24.190.62:46029)
0928 20:15:09.585271 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.585278 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.585304 (+ 26us) server_negotiation.cc:407] Connection header received
0928 20:15:09.585785 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.585792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.585853 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.586024 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.586399 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.587528 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.588693 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.589134 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.589227 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.590017 (+ 790us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.590021 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.590022 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.590309 (+ 287us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.590356 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.590373 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.590451 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.590542 (+ 91us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.590719 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106,"thread_start_us":81,"threads_started":1}
I20260928 20:15:09.590991 30635 raft_consensus.cc:504] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd381b90754e44d88a004ebc862f5372" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46029 } }
I20260928 20:15:09.591101 30635 leader_election.cc:302] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cd381b90754e44d88a004ebc862f5372; no voters:
I20260928 20:15:09.591310 30635 leader_election.cc:288] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:09.591379 30640 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:09.591512 30640 raft_consensus.cc:686] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [term 1 LEADER]: Becoming Leader. State: Replica: cd381b90754e44d88a004ebc862f5372, State: Running, Role: LEADER
I20260928 20:15:09.591560 30635 sys_catalog.cc:564] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:09.591609 30640 consensus_queue.cc:237] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd381b90754e44d88a004ebc862f5372" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46029 } }
I20260928 20:15:09.591843 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:15:09.591964 30642 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cd381b90754e44d88a004ebc862f5372. Latest consensus state: current_term: 1 leader_uuid: "cd381b90754e44d88a004ebc862f5372" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd381b90754e44d88a004ebc862f5372" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46029 } } }
I20260928 20:15:09.592124 30641 sys_catalog.cc:455] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cd381b90754e44d88a004ebc862f5372" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cd381b90754e44d88a004ebc862f5372" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46029 } } }
I20260928 20:15:09.592224 30641 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:09.592199 30642 sys_catalog.cc:458] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:09.592443 30649 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:09.592936 30649 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:09.594420 30649 catalog_manager.cc:1347] Generated new cluster ID: 3f9ffd5bba864a20bb2a79dcca6921a8
I20260928 20:15:09.594471 30649 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:09.601680 30649 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:09.602404 30649 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:09.610548 30649 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cd381b90754e44d88a004ebc862f5372: Generated new TSK 0
I20260928 20:15:09.610774 30649 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260928 20:15:09.630504 30665 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260928 20:15:09.630600 30665 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260928 20:15:09.630949 30638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.616348 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46558 (local address 127.24.190.62:46029)
0928 20:15:09.616409 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.616412 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.616537 (+ 125us) server_negotiation.cc:407] Connection header received
0928 20:15:09.616579 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.616580 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.616593 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.616683 (+ 90us) server_negotiation.cc:226] Negotiated authn=JWT
0928 20:15:09.616799 (+ 116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.617589 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.618442 (+ 853us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.618760 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.618831 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.618994 (+ 163us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 20:15:09.630719 (+ 11725us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38973/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0928 20:15:09.630873 (+ 154us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46558: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38973/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":39}
W20260928 20:15:09.631011 30638 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46558: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38973/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260928 20:15:09.631044 30664 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:09.616256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46029 (local address 127.0.0.1:46558)
0928 20:15:09.616458 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.616469 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.616533 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.616687 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.616688 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.616689 (+ 1us) client_negotiation.cc:189] Negotiated authn=JWT
0928 20:15:09.616737 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:09.616739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.617696 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.617697 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:09.618363 (+ 666us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:09.618371 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.618852 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.618853 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:09.618894 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.618899 (+ 5us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 20:15:09.630844 (+ 11945us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38973/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0928 20:15:09.630942 (+ 98us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.190.62:46029: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:38973/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":157,"threads_started":1}
I20260928 20:15:09.631470 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30568
2026-09-28T20:15:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (208 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260928 20:15:09.668901 25336 mini_oidc.cc:152] Starting JWKS server
I20260928 20:15:09.669631 25336 webserver.cc:460] Webserver started at https://127.0.0.1:37607/ using document root <none> and password file <none>
I20260928 20:15:09.669703 25336 mini_oidc.cc:189] Starting OIDC Discovery server
I20260928 20:15:09.669888 25336 webserver.cc:460] Webserver started at http://127.0.0.1:33823/ using document root <none> and password file <none>
2026-09-28T20:15:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:09Z Disabled control of system clock
I20260928 20:15:09.677418 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43521
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:42323
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43521
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37607/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260928 20:15:09.757835 30671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:09.758044 30671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:09.758067 30671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:09.759212 30671 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:09.759250 30671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:09.759263 30671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:09.759282 30671 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:09.759294 30671 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 20:15:09.759306 30671 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 20:15:09.759318 30671 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37607/jwks.json
I20260928 20:15:09.760655 30671 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:42323
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43521
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43521
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37607/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:09.760854 30671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:09.761091 30671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:09.766042 30676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:09.766018 30677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.766162 30671 server_base.cc:1034] running on GCE node
W20260928 20:15:09.766033 30679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.766527 30671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:09.766845 30671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:09.768040 30671 hybrid_clock.cc:648] HybridClock initialized: now 1790626509768024 us; error 48 us; skew 500 ppm
I20260928 20:15:09.769380 30671 webserver.cc:460] Webserver started at http://127.24.190.62:38615/ using document root <none> and password file <none>
I20260928 20:15:09.769640 30671 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:09.769716 30671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:09.769886 30671 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:09.771045 30671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "35fd198067a247769b064354fe3dc76d"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "db69cd2e214dd67fa2ac61e26f1e71be"
server_key_iv: "947c18ba4f2541d0b23bb487b130dc59"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.771407 30671 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "35fd198067a247769b064354fe3dc76d"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "db69cd2e214dd67fa2ac61e26f1e71be"
server_key_iv: "947c18ba4f2541d0b23bb487b130dc59"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.772747 30671 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:09.773488 30685 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.773662 30671 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:09.773756 30671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "35fd198067a247769b064354fe3dc76d"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "db69cd2e214dd67fa2ac61e26f1e71be"
server_key_iv: "947c18ba4f2541d0b23bb487b130dc59"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.773846 30671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:09.786960 30671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:09.787285 30671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:09.787446 30671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:09.791558 30671 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43521
I20260928 20:15:09.791608 30737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43521 every 8 connection(s)
I20260928 20:15:09.791942 30671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:09.792558 30738 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:09.795388 30738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d: Bootstrap starting.
I20260928 20:15:09.795979 30738 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:09.796265 30738 log.cc:824] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:09.797231 30738 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d: No bootstrap required, opened a new log
I20260928 20:15:09.799083 30738 raft_consensus.cc:348] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fd198067a247769b064354fe3dc76d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43521 } }
I20260928 20:15:09.799223 30738 raft_consensus.cc:374] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:09.799247 30738 raft_consensus.cc:729] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35fd198067a247769b064354fe3dc76d, State: Initialized, Role: FOLLOWER
I20260928 20:15:09.799407 30738 consensus_queue.cc:260] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fd198067a247769b064354fe3dc76d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43521 } }
I20260928 20:15:09.799501 30738 raft_consensus.cc:388] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:09.799543 30738 raft_consensus.cc:482] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:09.799594 30738 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:09.800192 30738 raft_consensus.cc:504] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fd198067a247769b064354fe3dc76d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43521 } }
I20260928 20:15:09.800310 30738 leader_election.cc:302] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 35fd198067a247769b064354fe3dc76d; no voters:
I20260928 20:15:09.800508 30738 leader_election.cc:288] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:09.800688 30741 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:09.800741 30738 sys_catalog.cc:564] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:09.800839 30741 raft_consensus.cc:686] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [term 1 LEADER]: Becoming Leader. State: Replica: 35fd198067a247769b064354fe3dc76d, State: Running, Role: LEADER
I20260928 20:15:09.800962 30741 consensus_queue.cc:237] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fd198067a247769b064354fe3dc76d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43521 } }
I20260928 20:15:09.801397 30742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "35fd198067a247769b064354fe3dc76d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fd198067a247769b064354fe3dc76d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43521 } } }
I20260928 20:15:09.801484 30742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:09.801635 30743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 35fd198067a247769b064354fe3dc76d. Latest consensus state: current_term: 1 leader_uuid: "35fd198067a247769b064354fe3dc76d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "35fd198067a247769b064354fe3dc76d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43521 } } }
I20260928 20:15:09.801707 30743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:09.801716 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30671
I20260928 20:15:09.801806 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:09.801993 25336 external_mini_cluster.cc:1428] Setting key f143e7040b67fc5588864bc845345b94
I20260928 20:15:09.802532 30750 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:09.803043 30750 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:09.804778 30750 catalog_manager.cc:1347] Generated new cluster ID: 0c57bd003aea4e7eb4a3b068e168f5fd
I20260928 20:15:09.804833 30750 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:09.807829 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.802714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37060 (local address 127.24.190.62:43521)
0928 20:15:09.803058 (+ 344us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.803068 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.803101 (+ 33us) server_negotiation.cc:407] Connection header received
0928 20:15:09.803234 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.803240 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.803296 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.803437 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:09.803695 (+ 258us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.804967 (+ 1272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.805757 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.806193 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.806347 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.807099 (+ 752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:09.807103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:09.807103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:09.807286 (+ 183us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:09.807318 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:09.807329 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:09.807403 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:09.807487 (+ 84us) server_negotiation.cc:299] Negotiation successful
0928 20:15:09.807659 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":78,"threads_started":1}
I20260928 20:15:09.808761 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:15:09.820792 30750 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:09.821398 30750 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:09.825448 30750 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 35fd198067a247769b064354fe3dc76d: Generated new TSK 0
I20260928 20:15:09.825637 30750 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:15:09.835004 30756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:09.831441 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37066 (local address 127.24.190.62:43521)
0928 20:15:09.831503 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:09.831505 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:09.831624 (+ 119us) server_negotiation.cc:407] Connection header received
0928 20:15:09.831704 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:09.831705 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:09.831718 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:09.831811 (+ 93us) server_negotiation.cc:226] Negotiated authn=JWT
0928 20:15:09.831966 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.832595 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.833380 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.833593 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.833670 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.833870 (+ 200us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 20:15:09.834805 (+ 935us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37607/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0928 20:15:09.834937 (+ 132us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:37066: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37607/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":40}
W20260928 20:15:09.835057 30756 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:37066: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37607/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260928 20:15:09.835116 30767 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:09.831380 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43521 (local address 127.0.0.1:37066)
0928 20:15:09.831558 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:09.831567 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:09.831642 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:09.831814 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:09.831814 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:09.831817 (+ 3us) client_negotiation.cc:189] Negotiated authn=JWT
0928 20:15:09.831890 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:09.831892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.832690 (+ 798us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.832692 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:09.833291 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:09.833293 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:09.833673 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:09.833674 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:09.833752 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:09.833764 (+ 12us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 20:15:09.834908 (+ 1144us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37607/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0928 20:15:09.835017 (+ 109us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.190.62:43521: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37607/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":160,"thread_start_us":98,"threads_started":1}
I20260928 20:15:09.835259 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30671
E20260928 20:15:09.846010 30768 webserver.cc:533] Webserver: sslize failed:
E20260928 20:15:09.846117 30768 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
2026-09-28T20:15:09Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (204 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-09-28T20:15:09Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:09Z Disabled control of system clock
I20260928 20:15:09.880496 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:34445
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:34997
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:34445
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/testchainca.cert with env {}
W20260928 20:15:09.962627 30772 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:09.962860 30772 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:09.962883 30772 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:09.964035 30772 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:09.964076 30772 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:09.964089 30772 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:09.964102 30772 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:09.964114 30772 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260928 20:15:09.964126 30772 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260928 20:15:09.964138 30772 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260928 20:15:09.965600 30772 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:34997
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:34445
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:34445
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30772
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:09.965814 30772 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:09.966017 30772 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:09.971235 30777 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:09.971235 30780 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.971395 30772 server_base.cc:1034] running on GCE node
W20260928 20:15:09.971266 30778 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:09.971717 30772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:09.972024 30772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:09.973191 30772 hybrid_clock.cc:648] HybridClock initialized: now 1790626509973162 us; error 38 us; skew 500 ppm
I20260928 20:15:09.974550 30772 webserver.cc:460] Webserver started at http://127.24.190.62:43249/ using document root <none> and password file <none>
I20260928 20:15:09.974823 30772 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:09.974871 30772 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:09.975042 30772 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:09.976166 30772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "0ddc7c3bf83740ab8c71d8b822867343"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "f938b55feab2f77f4848eebecbd96eb5"
server_key_iv: "155543d65dc3b08f5e3af950d7129caf"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.976534 30772 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "0ddc7c3bf83740ab8c71d8b822867343"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "f938b55feab2f77f4848eebecbd96eb5"
server_key_iv: "155543d65dc3b08f5e3af950d7129caf"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.977875 30772 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:09.978653 30786 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.978806 30772 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:09.978914 30772 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "0ddc7c3bf83740ab8c71d8b822867343"
format_stamp: "Formatted at 2026-09-28 20:15:09 on dist-test-slave-n45k"
server_key: "f938b55feab2f77f4848eebecbd96eb5"
server_key_iv: "155543d65dc3b08f5e3af950d7129caf"
server_key_version: "encryptionkey@0"
I20260928 20:15:09.978991 30772 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:09.992295 30772 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:09.992626 30772 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:09.992785 30772 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:09.997036 30772 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:34445
I20260928 20:15:09.997079 30838 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:34445 every 8 connection(s)
I20260928 20:15:09.997431 30772 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:09.998548 30839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:10.000852 30839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343: Bootstrap starting.
I20260928 20:15:10.001479 30839 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:10.001783 30839 log.cc:824] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:10.002568 30839 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343: No bootstrap required, opened a new log
I20260928 20:15:10.004222 30839 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc7c3bf83740ab8c71d8b822867343" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34445 } }
I20260928 20:15:10.004369 30839 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:10.004391 30839 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ddc7c3bf83740ab8c71d8b822867343, State: Initialized, Role: FOLLOWER
I20260928 20:15:10.004576 30839 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc7c3bf83740ab8c71d8b822867343" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34445 } }
I20260928 20:15:10.004678 30839 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:10.004715 30839 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:10.004721 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30772
I20260928 20:15:10.004767 30839 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:10.004824 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:10.005024 25336 external_mini_cluster.cc:1428] Setting key d3129f75c098dd556262c494e1f3449f
I20260928 20:15:10.005509 30839 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc7c3bf83740ab8c71d8b822867343" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34445 } }
I20260928 20:15:10.005622 30839 leader_election.cc:302] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ddc7c3bf83740ab8c71d8b822867343; no voters:
I20260928 20:15:10.005792 30839 leader_election.cc:288] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:10.005831 30844 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:10.005939 30844 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [term 1 LEADER]: Becoming Leader. State: Replica: 0ddc7c3bf83740ab8c71d8b822867343, State: Running, Role: LEADER
I20260928 20:15:10.006021 30844 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc7c3bf83740ab8c71d8b822867343" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34445 } }
I20260928 20:15:10.006078 30839 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:10.006484 30845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ddc7c3bf83740ab8c71d8b822867343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc7c3bf83740ab8c71d8b822867343" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34445 } } }
I20260928 20:15:10.006709 30845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:10.006646 30846 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ddc7c3bf83740ab8c71d8b822867343. Latest consensus state: current_term: 1 leader_uuid: "0ddc7c3bf83740ab8c71d8b822867343" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ddc7c3bf83740ab8c71d8b822867343" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34445 } } }
I20260928 20:15:10.006968 30846 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:10.007128 30853 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:10.007624 30853 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:10.009356 30853 catalog_manager.cc:1347] Generated new cluster ID: 1a57cba48184449e8fc60f5e71d1a48b
I20260928 20:15:10.009405 30853 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:10.011402 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:10.005553 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50234 (local address 127.24.190.62:34445)
0928 20:15:10.005807 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:10.005815 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:10.005868 (+ 53us) server_negotiation.cc:407] Connection header received
0928 20:15:10.006012 (+ 144us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:10.006021 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:10.006100 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:10.006653 (+ 553us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:10.006755 (+ 102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:10.008130 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:10.009192 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:10.009794 (+ 602us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:10.009909 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:10.010689 (+ 780us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:10.010692 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:10.010693 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:10.010915 (+ 222us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:10.010955 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:10.010968 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:10.011031 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:10.011131 (+ 100us) server_negotiation.cc:299] Negotiation successful
0928 20:15:10.011202 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":183,"thread_start_us":96,"threads_started":1}
I20260928 20:15:10.012416 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:15:10.019616 30853 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:10.020149 30853 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:10.024600 30853 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ddc7c3bf83740ab8c71d8b822867343: Generated new TSK 0
I20260928 20:15:10.024786 30853 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:15:10.463798 30843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:10.035244 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50248 (local address 127.24.190.62:34445)
0928 20:15:10.035311 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:10.035313 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:10.035326 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:15:10.035435 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:10.035436 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:10.035447 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:10.035510 (+ 63us) server_negotiation.cc:226] Negotiated authn=JWT
0928 20:15:10.035655 (+ 145us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:10.036158 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:10.037479 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:10.037674 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:10.037747 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:10.037987 (+ 240us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0928 20:15:10.463560 (+425573us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0928 20:15:10.463735 (+ 175us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:50248: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":37}
W20260928 20:15:10.463927 30843 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:50248: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260928 20:15:10.463961 30868 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:10.035113 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34445 (local address 127.0.0.1:50248)
0928 20:15:10.035272 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:10.035283 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:10.035351 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:10.035529 (+ 178us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:10.035530 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:10.035532 (+ 2us) client_negotiation.cc:189] Negotiated authn=JWT
0928 20:15:10.035591 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:10.035593 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:10.036244 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:10.036246 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:10.037179 (+ 933us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:10.037182 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:10.037771 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:10.037773 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:10.037838 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:10.037845 (+ 7us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0928 20:15:10.463723 (+425878us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0928 20:15:10.463876 (+ 153us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.24.190.62:34445: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
I20260928 20:15:10.464489 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30772
2026-09-28T20:15:10Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (609 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (88 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (89 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:10 dist-test-slave-n45k krb5kdc[30880](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:10 dist-test-slave-n45k krb5kdc[30880](info): set up 2 sockets
Sep 28 20:15:10 dist-test-slave-n45k krb5kdc[30880](info): commencing operation
krb5kdc: starting...
W20260928 20:15:11.694913 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:11 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:15:11.817433 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42695
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:42695
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:11.898252 30893 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:11.898562 30893 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:11.898602 30893 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:11.899814 30893 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:11.899896 30893 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:11.899919 30893 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:11.899940 30893 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:11.899971 30893 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:11.901515 30893 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:42695
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42695
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30893
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:11.901821 30893 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:11.902069 30893 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:11.907334 30901 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:11.907287 30899 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:11.907296 30898 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:11.907617 30893 server_base.cc:1034] running on GCE node
I20260928 20:15:11.907864 30893 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:11.908118 30893 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:11.909287 30893 hybrid_clock.cc:648] HybridClock initialized: now 1790626511909271 us; error 33 us; skew 500 ppm
Sep 28 20:15:11 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626511, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:11.911919 30893 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:11.912392 30893 webserver.cc:460] Webserver started at http://127.24.190.62:43917/ using document root <none> and password file <none>
I20260928 20:15:11.912581 30893 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:11.912622 30893 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:11.912711 30893 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:11.913745 30893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "b43cea51fa954fcda56db40468683897"
format_stamp: "Formatted at 2026-09-28 20:15:11 on dist-test-slave-n45k"
server_key: "19a515c6120fbdbcffdad6e80277ef89"
server_key_iv: "58da0d37e59e6a22c7782c954bf11d87"
server_key_version: "encryptionkey@0"
I20260928 20:15:11.914062 30893 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "b43cea51fa954fcda56db40468683897"
format_stamp: "Formatted at 2026-09-28 20:15:11 on dist-test-slave-n45k"
server_key: "19a515c6120fbdbcffdad6e80277ef89"
server_key_iv: "58da0d37e59e6a22c7782c954bf11d87"
server_key_version: "encryptionkey@0"
I20260928 20:15:11.915475 30893 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:15:11.916306 30908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:11.916491 30893 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:11.916604 30893 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "b43cea51fa954fcda56db40468683897"
format_stamp: "Formatted at 2026-09-28 20:15:11 on dist-test-slave-n45k"
server_key: "19a515c6120fbdbcffdad6e80277ef89"
server_key_iv: "58da0d37e59e6a22c7782c954bf11d87"
server_key_version: "encryptionkey@0"
I20260928 20:15:11.916684 30893 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:11.926616 30893 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:11.928664 30893 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:11.928824 30893 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:11.932847 30893 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:42695
I20260928 20:15:11.932874 30960 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:42695 every 8 connection(s)
I20260928 20:15:11.933236 30893 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:11.934101 30961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:11.936339 30961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897: Bootstrap starting.
I20260928 20:15:11.936852 30961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:11.937088 30961 log.cc:824] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:11.937698 30961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897: No bootstrap required, opened a new log
I20260928 20:15:11.939254 30961 raft_consensus.cc:348] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43cea51fa954fcda56db40468683897" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42695 } }
I20260928 20:15:11.939389 30961 raft_consensus.cc:374] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:11.939414 30961 raft_consensus.cc:729] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b43cea51fa954fcda56db40468683897, State: Initialized, Role: FOLLOWER
I20260928 20:15:11.939549 30961 consensus_queue.cc:260] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43cea51fa954fcda56db40468683897" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42695 } }
I20260928 20:15:11.939627 30961 raft_consensus.cc:388] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:11.939651 30961 raft_consensus.cc:482] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:11.939678 30961 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:11.940173 30961 raft_consensus.cc:504] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43cea51fa954fcda56db40468683897" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42695 } }
I20260928 20:15:11.940258 30961 leader_election.cc:302] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b43cea51fa954fcda56db40468683897; no voters:
I20260928 20:15:11.940383 30961 leader_election.cc:288] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:11.940461 30964 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:11.940632 30961 sys_catalog.cc:564] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:11.940793 30964 raft_consensus.cc:686] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [term 1 LEADER]: Becoming Leader. State: Replica: b43cea51fa954fcda56db40468683897, State: Running, Role: LEADER
I20260928 20:15:11.940891 30964 consensus_queue.cc:237] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43cea51fa954fcda56db40468683897" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42695 } }
I20260928 20:15:11.941273 30965 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b43cea51fa954fcda56db40468683897" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43cea51fa954fcda56db40468683897" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42695 } } }
I20260928 20:15:11.941382 30965 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:11.941617 30973 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:11.941601 30966 sys_catalog.cc:455] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b43cea51fa954fcda56db40468683897. Latest consensus state: current_term: 1 leader_uuid: "b43cea51fa954fcda56db40468683897" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b43cea51fa954fcda56db40468683897" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42695 } } }
I20260928 20:15:11.941793 30966 sys_catalog.cc:458] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:11.942189 30973 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:11.942168 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30893
I20260928 20:15:11.942303 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:11.942492 25336 external_mini_cluster.cc:1428] Setting key 338f3fec38259796d5f0fcc2285dc5a3
I20260928 20:15:11.944025 30973 catalog_manager.cc:1347] Generated new cluster ID: 1b294b7d9a694b0f820442ae76e5f971
I20260928 20:15:11.944082 30973 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:15:11 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626511, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:11.954672 30984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:11.943468 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53730 (local address 127.24.190.62:42695)
0928 20:15:11.943625 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:11.943635 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:11.943669 (+ 34us) server_negotiation.cc:407] Connection header received
0928 20:15:11.943790 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:11.943797 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:11.943866 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:11.944000 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:11.944809 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:11.946294 (+ 1485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:11.947345 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:11.948021 (+ 676us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:11.948139 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:11.950943 (+ 2804us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:11.950947 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:11.950948 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:11.950960 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:11.952861 (+ 1901us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:11.953261 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:11.953264 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:11.953264 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:11.953375 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:11.953583 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:11.953584 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:11.953584 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:11.953892 (+ 308us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:11.954030 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:11.954153 (+ 123us) server_negotiation.cc:299] Negotiation successful
0928 20:15:11.954433 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":114,"thread_start_us":83,"threads_started":1}
I20260928 20:15:11.968216 30973 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:11.968802 30973 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:11.971194 30973 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b43cea51fa954fcda56db40468683897: Generated new TSK 0
I20260928 20:15:11.971387 30973 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:15:11.996858 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42695
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:12.078639 30987 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:12.078847 30987 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:12.078871 30987 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:12.080030 30987 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:12.080073 30987 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:12.080099 30987 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:12.081676 30987 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.30987
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:12.081920 30987 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:12.082162 30987 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:12.087499 30992 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:12.087514 30995 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:12.087495 30993 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:12.087853 30987 server_base.cc:1034] running on GCE node
I20260928 20:15:12.088079 30987 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:12.088320 30987 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:12.089478 30987 hybrid_clock.cc:648] HybridClock initialized: now 1790626512089464 us; error 30 us; skew 500 ppm
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.092386 30987 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:15:12.092973 30987 webserver.cc:460] Webserver started at http://127.24.190.1:33563/ using document root <none> and password file <none>
I20260928 20:15:12.093245 30987 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:12.093307 30987 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:12.093473 30987 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:12.094586 30987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "98e990297d394b28bc73a8052dfbf224"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "97aa8f196f276e3b9aabfdfa328e0b34"
server_key_iv: "56df7365f90c094b495ff41fa1f8bf8a"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.094933 30987 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "98e990297d394b28bc73a8052dfbf224"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "97aa8f196f276e3b9aabfdfa328e0b34"
server_key_iv: "56df7365f90c094b495ff41fa1f8bf8a"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.096246 30987 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:12.097038 31002 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.097216 30987 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:12.097311 30987 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "98e990297d394b28bc73a8052dfbf224"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "97aa8f196f276e3b9aabfdfa328e0b34"
server_key_iv: "56df7365f90c094b495ff41fa1f8bf8a"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.097409 30987 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:12.111426 30987 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:12.113421 30987 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:12.113584 30987 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:12.113818 30987 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:12.114133 30987 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:12.114192 30987 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.114244 30987 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:12.114298 30987 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.120340 30987 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:42755
I20260928 20:15:12.120428 31115 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:42755 every 8 connection(s)
I20260928 20:15:12.120723 30987 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:12.121672 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 30987
I20260928 20:15:12.121779 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:12.121964 25336 external_mini_cluster.cc:1428] Setting key bd80a533450d4411b081d7d018a4211e
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:15:12.130745 30984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.121492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:59877 (local address 127.24.190.62:42695)
0928 20:15:12.121565 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.121568 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.121778 (+ 210us) server_negotiation.cc:407] Connection header received
0928 20:15:12.122854 (+ 1076us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.122856 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.122871 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.122918 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.123565 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.124075 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.125107 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.125330 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.125418 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.127564 (+ 2146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:12.127565 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:12.127566 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:12.127576 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:12.129180 (+ 1604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.129702 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.129704 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.129704 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.129768 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.130025 (+ 257us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.130026 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.130027 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.130145 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:12.130223 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:12.130565 (+ 342us) server_negotiation.cc:299] Negotiation successful
0928 20:15:12.130654 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:15:12.130940 31118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.121469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42695 (local address 127.24.190.1:59877)
0928 20:15:12.121639 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:12.121680 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:12.122743 (+ 1063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:12.122990 (+ 247us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:12.122994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:12.123272 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:12.123463 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:12.123467 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.124179 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.124181 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:12.125002 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:12.125004 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.125427 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.125428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:12.125557 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.126088 (+ 531us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:12.126096 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:12.127467 (+ 1371us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:12.129332 (+ 1865us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:12.129340 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:12.129342 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:12.129625 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:12.129843 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:12.129844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:12.129845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:12.129959 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:12.130213 (+ 254us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:12.130220 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:12.130417 (+ 197us) client_negotiation.cc:769] Sending connection context
0928 20:15:12.130543 (+ 126us) client_negotiation.cc:240] Negotiation successful
0928 20:15:12.130697 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":100,"threads_started":1}
I20260928 20:15:12.131479 31116 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42695
I20260928 20:15:12.131572 31116 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:12.131737 31116 heartbeater.cc:511] Master 127.24.190.62:42695 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
I20260928 20:15:12.132252 30925 ts_manager.cc:194] Registered new tserver with Master: 98e990297d394b28bc73a8052dfbf224 (127.24.190.1:42755)
I20260928 20:15:12.132843 30925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:59877
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:15:12.149103 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42695
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:12.230767 31121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:12.230988 31121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:12.231012 31121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:12.232223 31121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:12.232268 31121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:12.232296 31121 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:12.233800 31121 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31121
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:12.234071 31121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:12.234341 31121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:12.239568 31127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:12.239570 31126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:12.239568 31129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:12.239969 31121 server_base.cc:1034] running on GCE node
I20260928 20:15:12.240198 31121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:12.240433 31121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:12.241644 31121 hybrid_clock.cc:648] HybridClock initialized: now 1790626512241595 us; error 54 us; skew 500 ppm
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.244486 31121 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:15:12.244908 31121 webserver.cc:460] Webserver started at http://127.24.190.2:45543/ using document root <none> and password file <none>
I20260928 20:15:12.245167 31121 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:12.245237 31121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:12.245381 31121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:12.246534 31121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "45f0aec3c7e24ba0901986867327c293"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "d990a3fafc9c1a0dc413bf36a90e163b"
server_key_iv: "738b674f0cb889e7c6e50118d5fbbef7"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.246879 31121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "45f0aec3c7e24ba0901986867327c293"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "d990a3fafc9c1a0dc413bf36a90e163b"
server_key_iv: "738b674f0cb889e7c6e50118d5fbbef7"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.248322 31121 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:12.249338 31136 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.249584 31121 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:12.249713 31121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "45f0aec3c7e24ba0901986867327c293"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "d990a3fafc9c1a0dc413bf36a90e163b"
server_key_iv: "738b674f0cb889e7c6e50118d5fbbef7"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.249795 31121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:12.261823 31121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:12.264155 31121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:12.264361 31121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:12.264595 31121 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:12.264910 31121 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:12.264966 31121 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.265000 31121 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:12.265027 31121 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.271337 31121 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:33117
I20260928 20:15:12.271378 31249 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:33117 every 8 connection(s)
I20260928 20:15:12.271710 31121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:12.273803 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31121
I20260928 20:15:12.273921 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:12.274237 25336 external_mini_cluster.cc:1428] Setting key f3ba89d0d6b63027ee39951c83243c11
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
I20260928 20:15:12.282776 30984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.272732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:48789 (local address 127.24.190.62:42695)
0928 20:15:12.272819 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.272822 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.272915 (+ 93us) server_negotiation.cc:407] Connection header received
0928 20:15:12.273956 (+ 1041us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.273958 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.273973 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.274045 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.274970 (+ 925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.275495 (+ 525us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.276985 (+ 1490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.277206 (+ 221us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.277274 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.279841 (+ 2567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:12.279843 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:12.279843 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:12.279852 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:12.281305 (+ 1453us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.281742 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.281744 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.281744 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.281810 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.282068 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.282069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.282069 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.282190 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:12.282263 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:12.282591 (+ 328us) server_negotiation.cc:299] Negotiation successful
0928 20:15:12.282683 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260928 20:15:12.282972 31252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.272636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42695 (local address 127.24.190.2:48789)
0928 20:15:12.272791 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:12.272844 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:12.273803 (+ 959us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:12.274213 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:12.274219 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:12.274626 (+ 407us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:12.274890 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:12.274897 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.275638 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.275639 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:12.276888 (+ 1249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:12.276892 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.277299 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.277300 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:12.277447 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.278027 (+ 580us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:12.278037 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:12.279730 (+ 1693us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:12.281409 (+ 1679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:12.281416 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:12.281419 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:12.281650 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:12.281880 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:12.281881 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:12.281881 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:12.281996 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:12.282265 (+ 269us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:12.282305 (+ 40us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:12.282459 (+ 154us) client_negotiation.cc:769] Sending connection context
0928 20:15:12.282572 (+ 113us) client_negotiation.cc:240] Negotiation successful
0928 20:15:12.282732 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":69,"threads_started":1}
I20260928 20:15:12.283540 31250 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42695
I20260928 20:15:12.283689 31250 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:12.283900 31250 heartbeater.cc:511] Master 127.24.190.62:42695 requested a full tablet report, sending...
I20260928 20:15:12.284390 30925 ts_manager.cc:194] Registered new tserver with Master: 45f0aec3c7e24ba0901986867327c293 (127.24.190.2:33117)
I20260928 20:15:12.284771 30925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:48789
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:15:12.301610 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42695
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35915
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:12.384423 31255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:12.384629 31255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:12.384650 31255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:12.385807 31255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:12.385849 31255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:12.385876 31255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:12.387374 31255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35915
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42695
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:12.387616 31255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:12.387843 31255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:12.392915 31261 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:12.392921 31260 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:12.392949 31255 server_base.cc:1034] running on GCE node
W20260928 20:15:12.392922 31263 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:12.393540 31255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:12.393777 31255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:12.394963 31255 hybrid_clock.cc:648] HybridClock initialized: now 1790626512394926 us; error 69 us; skew 500 ppm
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.397511 31255 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:15:12.398044 31255 webserver.cc:460] Webserver started at http://127.24.190.3:39433/ using document root <none> and password file <none>
I20260928 20:15:12.398317 31255 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:12.398404 31255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:12.398557 31255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:12.399657 31255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "ff23241b20d340108de5b80ec8e983d1"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "3c03879b58ce5767c4c9e6218c870010"
server_key_iv: "f9be98fe5aa9e2cb9a504bf63e9865bb"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.400039 31255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "ff23241b20d340108de5b80ec8e983d1"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "3c03879b58ce5767c4c9e6218c870010"
server_key_iv: "f9be98fe5aa9e2cb9a504bf63e9865bb"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.401463 31255 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:12.402215 31270 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.402570 31255 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:12.402694 31255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "ff23241b20d340108de5b80ec8e983d1"
format_stamp: "Formatted at 2026-09-28 20:15:12 on dist-test-slave-n45k"
server_key: "3c03879b58ce5767c4c9e6218c870010"
server_key_iv: "f9be98fe5aa9e2cb9a504bf63e9865bb"
server_key_version: "encryptionkey@0"
I20260928 20:15:12.402850 31255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:12.434928 31255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:12.437319 31255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:12.437484 31255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:12.437783 31255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:12.438118 31255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:12.438151 31255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.438174 31255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:12.438222 31255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:12.444561 31255 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:32887
I20260928 20:15:12.444602 31383 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:32887 every 8 connection(s)
I20260928 20:15:12.444922 31255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:12.447036 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31255
I20260928 20:15:12.447158 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:12.447350 25336 external_mini_cluster.cc:1428] Setting key 1629adb172e47d4deee3cc0ba6ad2a3a
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:12.455003 30984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.445610 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:60469 (local address 127.24.190.62:42695)
0928 20:15:12.445687 (+ 77us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.445690 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.445885 (+ 195us) server_negotiation.cc:407] Connection header received
0928 20:15:12.446882 (+ 997us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.446883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.446894 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.446949 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.447814 (+ 865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.448546 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.449571 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.449759 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.449814 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.452003 (+ 2189us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:12.452004 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:12.452004 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:12.452014 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:12.453441 (+ 1427us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.453956 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.453957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.453957 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.454008 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.454364 (+ 356us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.454365 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.454365 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.454469 (+ 104us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:12.454551 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:12.454826 (+ 275us) server_negotiation.cc:299] Negotiation successful
0928 20:15:12.454906 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 20:15:12.455199 31386 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.445592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42695 (local address 127.24.190.3:60469)
0928 20:15:12.445758 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:12.445794 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:12.446764 (+ 970us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:12.447030 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:12.447034 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:12.447407 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:12.447700 (+ 293us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:12.447706 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.448631 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.448632 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:12.449491 (+ 859us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:12.449493 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.449867 (+ 374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.449868 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:12.449975 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.450495 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:12.450503 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:12.451908 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:12.453512 (+ 1604us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:12.453518 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:12.453519 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:12.453888 (+ 369us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:12.454086 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:12.454087 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:12.454087 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:12.454221 (+ 134us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:12.454544 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:12.454550 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:12.454688 (+ 138us) client_negotiation.cc:769] Sending connection context
0928 20:15:12.454791 (+ 103us) client_negotiation.cc:240] Negotiation successful
0928 20:15:12.454970 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":105,"threads_started":1}
I20260928 20:15:12.455646 31384 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42695
I20260928 20:15:12.455724 31384 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:12.455899 31384 heartbeater.cc:511] Master 127.24.190.62:42695 requested a full tablet report, sending...
I20260928 20:15:12.456285 30925 ts_manager.cc:194] Registered new tserver with Master: ff23241b20d340108de5b80ec8e983d1 (127.24.190.3:32887)
I20260928 20:15:12.456681 30925 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:60469
I20260928 20:15:12.459000 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/test-admin.keytab.
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.475296 25336 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260928 20:15:12.477053 31391 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:12.476295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46342 (local address 127.24.190.1:42755)
0928 20:15:12.476481 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.476486 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.476496 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:12.476521 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.476523 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.476536 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.476601 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.476972 (+ 371us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46342: BlockingRecv error: recv got EOF from 127.0.0.1:46342 (error 108)
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":105,"threads_started":1}
W20260928 20:15:12.477228 25336 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc' of type FILE
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.478255 25336 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.479229 25336 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:15:12.487016 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.479792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46348 (local address 127.24.190.1:42755)
0928 20:15:12.479852 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.479854 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.479934 (+ 80us) server_negotiation.cc:407] Connection header received
0928 20:15:12.479975 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.479976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.479987 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.480039 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.480446 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.481191 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.481920 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.482236 (+ 316us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.482380 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.484490 (+ 2110us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:12.484497 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:12.484497 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:12.484505 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:12.485897 (+ 1392us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.486201 (+ 304us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.486204 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.486204 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.486262 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.486484 (+ 222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.486485 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.486485 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.486616 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:12.486718 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:12.486792 (+ 74us) server_negotiation.cc:299] Negotiation successful
0928 20:15:12.486854 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
W20260928 20:15:12.488849 31391 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:12.488247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46356 (local address 127.24.190.1:42755)
0928 20:15:12.488284 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.488286 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.488417 (+ 131us) server_negotiation.cc:407] Connection header received
0928 20:15:12.488452 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.488453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.488461 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.488506 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.488818 (+ 312us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46356: BlockingRecv error: recv got EOF from 127.0.0.1:46356 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260928 20:15:12.488942 25336 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc' of type FILE
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.489928 25336 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.490929 25336 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:15:12.497176 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.491429 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46362 (local address 127.24.190.1:42755)
0928 20:15:12.491488 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.491490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.491503 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:15:12.491524 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.491525 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.491532 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.491575 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.491908 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.492359 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.493010 (+ 651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.493194 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.493249 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.495151 (+ 1902us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:12.495152 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:12.495152 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:12.495158 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:12.496303 (+ 1145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.496594 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.496595 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.496595 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.496642 (+ 47us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.496800 (+ 158us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.496801 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.496801 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.496895 (+ 94us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:12.496963 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:12.497063 (+ 100us) server_negotiation.cc:299] Negotiation successful
0928 20:15:12.497121 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
W20260928 20:15:12.498852 31391 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:12.498113 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46368 (local address 127.24.190.1:42755)
0928 20:15:12.498169 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.498171 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.498211 (+ 40us) server_negotiation.cc:407] Connection header received
0928 20:15:12.498352 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.498353 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.498368 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.498434 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.498808 (+ 374us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:46368: BlockingRecv error: recv got EOF from 127.0.0.1:46368 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
W20260928 20:15:12.498931 25336 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1790626483051462-25336-0/krb5kdc/krb5cc' of type FILE
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.499908 25336 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:12.500792 25336 init.cc:295] Successfully reacquired a new kerberos TGT
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[30880](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626512, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:15:12.507993 31391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:12.501287 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46370 (local address 127.24.190.1:42755)
0928 20:15:12.501368 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:12.501370 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:12.501383 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:15:12.501482 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:12.501483 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:12.501492 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:12.501547 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:12.501917 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.502454 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.503131 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:12.503342 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:12.503433 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:12.505565 (+ 2132us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:12.505566 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:12.505567 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:12.505574 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:12.506892 (+ 1318us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.507212 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.507213 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.507213 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.507306 (+ 93us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:12.507538 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:12.507539 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:12.507539 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:12.507630 (+ 91us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:12.507701 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:12.507803 (+ 102us) server_negotiation.cc:299] Negotiation successful
0928 20:15:12.507858 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 20:15:12.508682 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30987
I20260928 20:15:12.513682 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31121
I20260928 20:15:12.518127 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31255
I20260928 20:15:12.522552 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 30893
2026-09-28T20:15:12Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (1882 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[31404](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[31404](info): set up 2 sockets
Sep 28 20:15:12 dist-test-slave-n45k krb5kdc[31404](info): commencing operation
krb5kdc: starting...
W20260928 20:15:13.567075 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:13 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:13Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:13Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab.
Entry for principal oryx/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab.
I20260928 20:15:13.689675 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46561
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab
--principal=oryx/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:46561
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:13.770927 31417 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:13.771147 31417 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:13.771169 31417 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:13.772372 31417 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:13.772416 31417 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:13.772430 31417 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:13.772471 31417 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:13.772500 31417 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:13.774168 31417 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:46561
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab
--principal=oryx/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46561
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31417
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:13.774468 31417 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:13.774718 31417 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:13.780174 31423 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:13.780167 31422 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:13.780169 31425 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:13.780655 31417 server_base.cc:1034] running on GCE node
I20260928 20:15:13.780951 31417 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:13.781205 31417 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:13.782372 31417 hybrid_clock.cc:648] HybridClock initialized: now 1790626513782353 us; error 48 us; skew 500 ppm
Sep 28 20:15:13 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:13.784979 31417 init.cc:377] Logged in from keytab as oryx/127.24.190.62@KRBTEST.COM (short username oryx)
I20260928 20:15:13.785473 31417 webserver.cc:460] Webserver started at http://127.24.190.62:42577/ using document root <none> and password file <none>
I20260928 20:15:13.785701 31417 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:13.785780 31417 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:13.785930 31417 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:13.787137 31417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "22e220e8afec4b34b802a870f0044a65"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "957898f980e5d008354eaf8f7c623b5f"
server_key_iv: "37bc2dd9e4df98022899309bd197bc50"
server_key_version: "encryptionkey@0"
I20260928 20:15:13.787509 31417 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "22e220e8afec4b34b802a870f0044a65"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "957898f980e5d008354eaf8f7c623b5f"
server_key_iv: "37bc2dd9e4df98022899309bd197bc50"
server_key_version: "encryptionkey@0"
I20260928 20:15:13.788892 31417 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:15:13.789608 31432 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:13.789803 31417 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:13.789927 31417 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "22e220e8afec4b34b802a870f0044a65"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "957898f980e5d008354eaf8f7c623b5f"
server_key_iv: "37bc2dd9e4df98022899309bd197bc50"
server_key_version: "encryptionkey@0"
I20260928 20:15:13.790025 31417 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:13.800879 31417 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:13.802886 31417 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:13.803048 31417 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:13.806958 31417 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:46561
I20260928 20:15:13.806993 31484 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:46561 every 8 connection(s)
I20260928 20:15:13.807361 31417 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:13.808373 31485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:13.810719 31485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Bootstrap starting.
I20260928 20:15:13.811298 31485 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:13.811627 31485 log.cc:824] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:13.812397 31485 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: No bootstrap required, opened a new log
I20260928 20:15:13.814002 31485 raft_consensus.cc:348] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } }
I20260928 20:15:13.814199 31485 raft_consensus.cc:374] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:13.814244 31485 raft_consensus.cc:729] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 22e220e8afec4b34b802a870f0044a65, State: Initialized, Role: FOLLOWER
I20260928 20:15:13.814359 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31417
I20260928 20:15:13.814471 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:13.814431 31485 consensus_queue.cc:260] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } }
I20260928 20:15:13.814517 31485 raft_consensus.cc:388] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:13.814553 31485 raft_consensus.cc:482] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:13.814620 31485 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:13.814673 25336 external_mini_cluster.cc:1428] Setting key bf52b2d3aacffa221f6485a556481175
I20260928 20:15:13.815747 31485 raft_consensus.cc:504] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } }
I20260928 20:15:13.815869 31485 leader_election.cc:302] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 22e220e8afec4b34b802a870f0044a65; no voters:
I20260928 20:15:13.816035 31485 leader_election.cc:288] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:13.816059 31490 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:13.816224 31490 raft_consensus.cc:686] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 LEADER]: Becoming Leader. State: Replica: 22e220e8afec4b34b802a870f0044a65, State: Running, Role: LEADER
I20260928 20:15:13.816300 31485 sys_catalog.cc:564] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:13.816365 31490 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } }
I20260928 20:15:13.818053 31492 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } }
I20260928 20:15:13.818707 31492 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:13.818229 31491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e220e8afec4b34b802a870f0044a65. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } }
I20260928 20:15:13.818975 31491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
W20260928 20:15:13.818499 31504 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:15:13.819062 31504 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:15:13.819136 31507 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:13.819329 31507 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:13.821028 31507 catalog_manager.cc:1347] Generated new cluster ID: 56e9fc06bd9d4c64961ac64fb818dd20
I20260928 20:15:13.821077 31507 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:15:13 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:13.826294 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:13.815173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51578 (local address 127.24.190.62:46561)
0928 20:15:13.815388 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:13.815396 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:13.815423 (+ 27us) server_negotiation.cc:407] Connection header received
0928 20:15:13.815517 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:13.815522 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:13.815564 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:13.815671 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:13.816464 (+ 793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:13.817523 (+ 1059us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:13.818622 (+ 1099us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:13.819208 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:13.819328 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:13.821974 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:13.821978 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:13.821979 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:13.821990 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:13.824064 (+ 2074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:13.824458 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:13.824461 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:13.824462 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:13.825082 (+ 620us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:13.825303 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:13.825304 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:13.825304 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:13.825646 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:13.825807 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:13.825887 (+ 80us) server_negotiation.cc:299] Negotiation successful
0928 20:15:13.826031 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":95,"threads_started":1}
I20260928 20:15:13.836517 31507 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:13.837105 31507 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:13.839524 31507 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Generated new TSK 0
I20260928 20:15:13.839718 31507 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab.
Entry for principal oryx/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab.
I20260928 20:15:13.866163 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46561
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:13.946950 31511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:13.947192 31511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:13.947233 31511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:13.948431 31511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:13.948499 31511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:13.948545 31511 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:13.950027 31511 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:13.950338 31511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:13.950569 31511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:13.956790 31519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:13.956749 31516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:13.956700 31517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:13.957087 31511 server_base.cc:1034] running on GCE node
I20260928 20:15:13.957399 31511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:13.957674 31511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:13.958877 31511 hybrid_clock.cc:648] HybridClock initialized: now 1790626513958865 us; error 30 us; skew 500 ppm
Sep 28 20:15:13 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:13.961781 31511 init.cc:377] Logged in from keytab as oryx/127.24.190.1@KRBTEST.COM (short username oryx)
I20260928 20:15:13.962237 31511 webserver.cc:460] Webserver started at http://127.24.190.1:43265/ using document root <none> and password file <none>
I20260928 20:15:13.962502 31511 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:13.962574 31511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:13.962721 31511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:13.963800 31511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "52fb0c67626c49aabe124cc62e74b233"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "b9d00e55f197d9061e64bb65460b0090"
server_key_iv: "3b716622481892d36d2dc3e6df44be15"
server_key_version: "encryptionkey@0"
I20260928 20:15:13.964157 31511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "52fb0c67626c49aabe124cc62e74b233"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "b9d00e55f197d9061e64bb65460b0090"
server_key_iv: "3b716622481892d36d2dc3e6df44be15"
server_key_version: "encryptionkey@0"
I20260928 20:15:13.965477 31511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:15:13.966223 31526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:13.966459 31511 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:13.966566 31511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "52fb0c67626c49aabe124cc62e74b233"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "b9d00e55f197d9061e64bb65460b0090"
server_key_iv: "3b716622481892d36d2dc3e6df44be15"
server_key_version: "encryptionkey@0"
I20260928 20:15:13.966641 31511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.033892 31511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.036324 31511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:14.036489 31511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.036738 31511 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:14.037067 31511 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:14.037120 31511 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.037163 31511 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:14.037191 31511 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.043107 31511 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:45995
I20260928 20:15:14.043148 31639 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:45995 every 8 connection(s)
I20260928 20:15:14.043512 31511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:14.052193 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31511
I20260928 20:15:14.052299 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:14.052513 25336 external_mini_cluster.cc:1428] Setting key 93fa247fdbbdf32c344e914f6c212aba
I20260928 20:15:14.052790 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.044292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:45949 (local address 127.24.190.62:46561)
0928 20:15:14.044371 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.044374 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.044570 (+ 196us) server_negotiation.cc:407] Connection header received
0928 20:15:14.045076 (+ 506us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.045077 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.045089 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.045143 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.046078 (+ 935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.046646 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.047650 (+ 1004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.047838 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.047888 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.050028 (+ 2140us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.050030 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.050030 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.050036 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.051398 (+ 1362us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.051757 (+ 359us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.051757 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.051758 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.051813 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.052051 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.052051 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.052052 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.052149 (+ 97us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.052199 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.052541 (+ 342us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.052658 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 20:15:14.052919 31642 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.044276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:45949)
0928 20:15:14.044452 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.044488 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.044992 (+ 504us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.045205 (+ 213us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.045208 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.045810 (+ 602us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.046001 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.046005 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.046765 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.046766 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.047574 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.047576 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.047906 (+ 330us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.047907 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.048011 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.048528 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.048536 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.049941 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.051473 (+ 1532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.051479 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.051481 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.051694 (+ 213us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.051871 (+ 177us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.051872 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.051872 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.051968 (+ 96us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.052212 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.052218 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.052394 (+ 176us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.052517 (+ 123us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.052689 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":98,"threads_started":1}
I20260928 20:15:14.053527 31640 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46561
I20260928 20:15:14.053658 31640 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:14.053850 31640 heartbeater.cc:511] Master 127.24.190.62:46561 requested a full tablet report, sending...
I20260928 20:15:14.054430 31449 ts_manager.cc:194] Registered new tserver with Master: 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995)
I20260928 20:15:14.055186 31449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:45949
WARNING: no policy specified for oryx/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab.
Entry for principal oryx/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab.
I20260928 20:15:14.077844 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46561
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:14.162106 31645 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:14.162381 31645 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:14.162423 31645 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:14.163591 31645 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:14.163661 31645 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:14.163705 31645 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:14.165163 31645 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31645
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:14.165431 31645 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:14.165664 31645 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:14.170719 31650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.170840 31651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.170735 31645 server_base.cc:1034] running on GCE node
W20260928 20:15:14.170724 31653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.171149 31645 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:14.171355 31645 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:14.172557 31645 hybrid_clock.cc:648] HybridClock initialized: now 1790626514172538 us; error 29 us; skew 500 ppm
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:14.175109 31645 init.cc:377] Logged in from keytab as oryx/127.24.190.2@KRBTEST.COM (short username oryx)
I20260928 20:15:14.175545 31645 webserver.cc:460] Webserver started at http://127.24.190.2:38041/ using document root <none> and password file <none>
I20260928 20:15:14.175771 31645 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.175824 31645 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.175987 31645 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:14.177083 31645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "16bc12e7f85f43439f943cb25f1bbda7"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "4a4dccb5e568a398a1b6e53cb8593ee5"
server_key_iv: "234894d1a118801eb3de1b3a7626395b"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.177488 31645 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "16bc12e7f85f43439f943cb25f1bbda7"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "4a4dccb5e568a398a1b6e53cb8593ee5"
server_key_iv: "234894d1a118801eb3de1b3a7626395b"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.179071 31645 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:14.179949 31660 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.180151 31645 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:14.180231 31645 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "16bc12e7f85f43439f943cb25f1bbda7"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "4a4dccb5e568a398a1b6e53cb8593ee5"
server_key_iv: "234894d1a118801eb3de1b3a7626395b"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.180284 31645 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.205482 31645 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.207863 31645 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:14.207978 31645 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.208163 31645 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:14.208475 31645 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:14.208516 31645 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.208539 31645 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:14.208585 31645 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.214587 31645 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:45169
I20260928 20:15:14.214668 31773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:45169 every 8 connection(s)
I20260928 20:15:14.214987 31645 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:14.222864 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31645
I20260928 20:15:14.222975 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:14.223176 25336 external_mini_cluster.cc:1428] Setting key 6067e69fcf4289b28b9ccf16927314cf
I20260928 20:15:14.224614 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.215738 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:44817 (local address 127.24.190.62:46561)
0928 20:15:14.215798 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.215800 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.216048 (+ 248us) server_negotiation.cc:407] Connection header received
0928 20:15:14.216621 (+ 573us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.216622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.216648 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.216711 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.217828 (+ 1117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.218427 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.219375 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.219575 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.219633 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.221690 (+ 2057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.221692 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.221692 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.221698 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.223118 (+ 1420us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.223626 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.223627 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.223628 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.223695 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.223956 (+ 261us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.223957 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.223958 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.224079 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.224157 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.224432 (+ 275us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.224525 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 20:15:14.224817 31776 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.215695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:44817)
0928 20:15:14.215920 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.215956 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.216505 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.216843 (+ 338us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.216848 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.217538 (+ 690us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.217735 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.217740 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.218504 (+ 764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.218505 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.219284 (+ 779us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.219286 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.219649 (+ 363us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.219649 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.219751 (+ 102us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.220237 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.220245 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.221602 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.223194 (+ 1592us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.223199 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.223201 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.223538 (+ 337us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.223764 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.223765 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.223766 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.223879 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.224147 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.224153 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.224293 (+ 140us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.224411 (+ 118us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.224563 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":188,"thread_start_us":144,"threads_started":1}
I20260928 20:15:14.225670 31774 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46561
I20260928 20:15:14.225802 31774 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:14.226014 31774 heartbeater.cc:511] Master 127.24.190.62:46561 requested a full tablet report, sending...
I20260928 20:15:14.226467 31449 ts_manager.cc:194] Registered new tserver with Master: 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169)
I20260928 20:15:14.226898 31449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:44817
WARNING: no policy specified for oryx/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab.
Entry for principal oryx/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab.
I20260928 20:15:14.249192 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46561
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:14.330571 31779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:14.330786 31779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:14.330811 31779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:14.331955 31779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:14.332000 31779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:14.332027 31779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:14.333531 31779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:46561
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:14.333771 31779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:14.333997 31779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:14.339165 31787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.339139 31785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.339319 31784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.339378 31779 server_base.cc:1034] running on GCE node
I20260928 20:15:14.339660 31779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:14.339938 31779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:14.341120 31779 hybrid_clock.cc:648] HybridClock initialized: now 1790626514341103 us; error 35 us; skew 500 ppm
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:14.343725 31779 init.cc:377] Logged in from keytab as oryx/127.24.190.3@KRBTEST.COM (short username oryx)
I20260928 20:15:14.344128 31779 webserver.cc:460] Webserver started at http://127.24.190.3:37459/ using document root <none> and password file <none>
I20260928 20:15:14.344372 31779 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.344417 31779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.344556 31779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:14.345641 31779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "a601c7fe836ae851c152a5d62ec94e79"
server_key_iv: "c3021377fae4e8c609c724ddd7a9a088"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.346012 31779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "a601c7fe836ae851c152a5d62ec94e79"
server_key_iv: "c3021377fae4e8c609c724ddd7a9a088"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.347438 31779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:14.348208 31794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.348407 31779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:14.348502 31779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "a601c7fe836ae851c152a5d62ec94e79"
server_key_iv: "c3021377fae4e8c609c724ddd7a9a088"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.348556 31779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.378978 31779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.380965 31779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:14.381074 31779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.381258 31779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:14.381577 31779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:14.381611 31779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.381633 31779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:14.381682 31779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.387754 31779 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36439
I20260928 20:15:14.387833 31907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36439 every 8 connection(s)
I20260928 20:15:14.388163 31779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:14.394049 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31779
I20260928 20:15:14.394147 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:14.394424 25336 external_mini_cluster.cc:1428] Setting key 8c2bedd4a940c27beb788ffc04e36453
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:14.397926 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.388973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:49541 (local address 127.24.190.62:46561)
0928 20:15:14.389034 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.389036 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.389304 (+ 268us) server_negotiation.cc:407] Connection header received
0928 20:15:14.389794 (+ 490us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.389795 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.389805 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.389865 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.391004 (+ 1139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.391489 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.392498 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.392679 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.392733 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.395316 (+ 2583us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.395318 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.395318 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.395326 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.396745 (+ 1419us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.397127 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.397127 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.397128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.397176 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.397410 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.397411 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.397411 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.397513 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.397566 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.397803 (+ 237us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.397863 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:15:14.398097 31910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.388959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:49541)
0928 20:15:14.389130 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.389177 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.389706 (+ 529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.389922 (+ 216us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.389925 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.390720 (+ 795us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.390922 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.390926 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.391573 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.391573 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.392427 (+ 854us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.392429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.392753 (+ 324us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.392754 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.392869 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.393397 (+ 528us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.393405 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.395210 (+ 1805us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.396832 (+ 1622us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.396839 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.396840 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.397059 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.397239 (+ 180us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.397240 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.397240 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.397353 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.397570 (+ 217us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.397574 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.397687 (+ 113us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.397769 (+ 82us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.397888 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260928 20:15:14.398594 31908 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46561
I20260928 20:15:14.398701 31908 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:14.398875 31908 heartbeater.cc:511] Master 127.24.190.62:46561 requested a full tablet report, sending...
I20260928 20:15:14.399230 31449 ts_manager.cc:194] Registered new tserver with Master: b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439)
I20260928 20:15:14.399593 31449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:49541
I20260928 20:15:14.406313 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.190.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.61.keytab.
Entry for principal oryx/127.24.190.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.61.keytab.
I20260928 20:15:14.430903 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:37251
--webserver_interface=127.24.190.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.61.keytab
--principal=oryx/127.24.190.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:46561,127.24.190.61:37251
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:14.510634 31913 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:14.510834 31913 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:14.510856 31913 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:14.511916 31913 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:14.511951 31913 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:14.511965 31913 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:14.511978 31913 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:14.511991 31913 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:14.513615 31913 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:46561,127.24.190.61:37251
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.61.keytab
--principal=oryx/127.24.190.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:37251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.190.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.31913
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
W20260928 20:15:14.513725 31913 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.24.190.62:46561,127.24.190.61:37251'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260928 20:15:14.513836 31913 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:14.513993 31913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:14.519323 31919 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.519335 31918 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.519320 31921 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.519477 31913 server_base.cc:1034] running on GCE node
I20260928 20:15:14.519695 31913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:14.519951 31913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:14.521088 31913 hybrid_clock.cc:648] HybridClock initialized: now 1790626514521067 us; error 36 us; skew 500 ppm
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:14.523546 31913 init.cc:377] Logged in from keytab as oryx/127.24.190.61@KRBTEST.COM (short username oryx)
I20260928 20:15:14.523981 31913 webserver.cc:460] Webserver started at http://127.24.190.61:37283/ using document root <none> and password file <none>
I20260928 20:15:14.524212 31913 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.524281 31913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.524431 31913 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:14.525493 31913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/instance:
uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "ebe922e3bd927c9479a7537fd3aedfda"
server_key_iv: "84229b125eb9f4ae2d63f625feaa6ee9"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.525856 31913 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal/instance:
uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "ebe922e3bd927c9479a7537fd3aedfda"
server_key_iv: "84229b125eb9f4ae2d63f625feaa6ee9"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.527244 31913 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:15:14.527968 31928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.528131 31913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:14.528227 31913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "ebe922e3bd927c9479a7537fd3aedfda"
server_key_iv: "84229b125eb9f4ae2d63f625feaa6ee9"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.528302 31913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.564321 31913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.567446 31913 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:14.567667 31913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.572362 31913 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.61:37251
I20260928 20:15:14.572399 31980 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.61:37251 every 8 connection(s)
I20260928 20:15:14.572798 31913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
I20260928 20:15:14.573870 31981 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:14.575421 31981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:15:14.575724 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 31913
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.61@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:14.585917 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.576485 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51594 (local address 127.24.190.62:46561)
0928 20:15:14.576530 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.576532 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.576721 (+ 189us) server_negotiation.cc:407] Connection header received
0928 20:15:14.577249 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.577251 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.577264 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.577325 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.577878 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.578470 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.579393 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.579608 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.579682 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.582215 (+ 2533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.582217 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.582217 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.582224 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.583946 (+ 1722us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.584559 (+ 613us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.584561 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.584561 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.584617 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.584949 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.584951 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.584951 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.585200 (+ 249us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.585390 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.585740 (+ 350us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.585817 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:15:14.586143 31985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.576364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:51594)
0928 20:15:14.576595 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.576642 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.577142 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.577346 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.577350 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.577619 (+ 269us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.577773 (+ 154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.577778 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.578568 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.578570 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.579280 (+ 710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.579282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.579700 (+ 418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.579700 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.579836 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.580432 (+ 596us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.580442 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.582108 (+ 1666us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.584044 (+ 1936us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.584052 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.584055 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.584468 (+ 413us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.584689 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.584690 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.584690 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.584822 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.585405 (+ 583us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.585410 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.585582 (+ 172us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.585714 (+ 132us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.585881 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":189,"spinlock_wait_cycles":9088,"thread_start_us":106,"threads_started":1}
I20260928 20:15:14.586439 31984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.576363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48148 (local address 127.24.190.61:37251)
0928 20:15:14.576713 (+ 350us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.576718 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.576745 (+ 27us) server_negotiation.cc:407] Connection header received
0928 20:15:14.577239 (+ 494us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.577245 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.577278 (+ 33us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.577412 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.578033 (+ 621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.578930 (+ 897us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.579643 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.579931 (+ 288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.580019 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.583072 (+ 3053us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.583078 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.583078 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.583084 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.585001 (+ 1917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.585412 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.585414 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.585415 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.585473 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.585670 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.585671 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.585671 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.585834 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.585971 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.586128 (+ 157us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.586207 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":313,"thread_start_us":95,"threads_started":1}
I20260928 20:15:14.586982 31981 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.61@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:14.593519 31984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.587251 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48156 (local address 127.24.190.61:37251)
0928 20:15:14.587308 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.587310 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.587318 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:14.587371 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.587371 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.587380 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.587425 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.587603 (+ 178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.588062 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.588897 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.589088 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.589141 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.591083 (+ 1942us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.591084 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.591085 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.591091 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.592420 (+ 1329us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.592725 (+ 305us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.592727 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.592727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.592781 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.592965 (+ 184us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.592966 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.592967 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.593087 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.593172 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.593296 (+ 124us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.593399 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":39,"server-negotiator.queue_time_us":39}
I20260928 20:15:14.593578 31985 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.587223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:48156)
0928 20:15:14.587276 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.587286 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.587332 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.587430 (+ 98us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.587430 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.587535 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.587566 (+ 31us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.587567 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.588266 (+ 699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.588267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.588820 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.588822 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.589231 (+ 409us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.589232 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.589282 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.589651 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.589656 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.591007 (+ 1351us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.592501 (+ 1494us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.592502 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.592502 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.592656 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.592849 (+ 193us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.592849 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.592849 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.592902 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.593174 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.593174 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.593210 (+ 36us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.593270 (+ 60us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.593350 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 20:15:14.595103 31981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Bootstrap starting.
I20260928 20:15:14.595981 31981 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:14.596268 31981 log.cc:824] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:14.597097 31981 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: No bootstrap required, opened a new log
I20260928 20:15:14.598719 31981 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } }
I20260928 20:15:14.598881 31981 raft_consensus.cc:374] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:14.598928 31981 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8d6d3ca1f6648fc90f0b5512244ccca, State: Initialized, Role: FOLLOWER
I20260928 20:15:14.599099 31981 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } }
I20260928 20:15:14.599421 31981 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:14.599447 31987 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } } }
I20260928 20:15:14.599568 31987 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:15:14.601464 31998 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:15:14.601531 31998 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:15:14.603459 31913 master_runner.cc:428] Detected that this master c8d6d3ca1f6648fc90f0b5512244ccca is joining an existing cluster
I20260928 20:15:14.603504 31913 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.190.61:37251
I20260928 20:15:14.611464 32005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.604621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:48160)
0928 20:15:14.604807 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.604818 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.604892 (+ 74us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.605051 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.605053 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.605303 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.605399 (+ 96us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.605401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.606048 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.606049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.606921 (+ 872us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.606923 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.607399 (+ 476us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.607400 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.607459 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.607974 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.607979 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.608405 (+ 426us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.610312 (+ 1907us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.610313 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.610313 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.610497 (+ 184us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.610703 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.610704 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.610704 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.610753 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.611056 (+ 303us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.611057 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.611107 (+ 50us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.611181 (+ 74us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.611303 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":90,"threads_started":1}
I20260928 20:15:14.611522 31984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.604810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48160 (local address 127.24.190.61:37251)
0928 20:15:14.604847 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.604849 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.604875 (+ 26us) server_negotiation.cc:407] Connection header received
0928 20:15:14.604948 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.604949 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.604959 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.605011 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.605488 (+ 477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.605986 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.607009 (+ 1023us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.607284 (+ 275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.607318 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.608511 (+ 1193us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.608512 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.608512 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.608519 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.610200 (+ 1681us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.610582 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.610583 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.610583 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.610635 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.610837 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.610839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.610839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.610984 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.611054 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.611221 (+ 167us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.611370 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":54,"server-negotiator.queue_time_us":20}
I20260928 20:15:14.611863 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.604688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51602 (local address 127.24.190.62:46561)
0928 20:15:14.604735 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.604737 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.605100 (+ 363us) server_negotiation.cc:407] Connection header received
0928 20:15:14.605128 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.605129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.605141 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.605197 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.605539 (+ 342us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.606383 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.607483 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.607786 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.607859 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.608949 (+ 1090us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.608951 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.608951 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.608958 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.610587 (+ 1629us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.610939 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.610940 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.610941 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.610998 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.611236 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.611237 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.611238 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.611369 (+ 131us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.611416 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.611647 (+ 231us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.611742 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:15:14.611799 32004 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.604623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:51602)
0928 20:15:14.605003 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.605011 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.605058 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.605214 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.605215 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.605400 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.605459 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.605461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.606466 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.606467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.607398 (+ 931us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.607400 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.607914 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.607915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.607985 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.608394 (+ 409us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.608398 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.608843 (+ 445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.610657 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.610658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.610658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.610857 (+ 199us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.611093 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.611094 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.611094 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.611162 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.611464 (+ 302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.611465 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.611504 (+ 39us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.611602 (+ 98us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.611700 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":358,"thread_start_us":87,"threads_started":1}
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.62@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:14.623584 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.614672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:48168)
0928 20:15:14.614819 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.614864 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.614939 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.615081 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.615083 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.615340 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.615403 (+ 63us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.615405 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.616332 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.616333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.617164 (+ 831us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.617168 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.618023 (+ 855us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.618024 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.618205 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.618860 (+ 655us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.618865 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.620352 (+ 1487us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.622232 (+ 1880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.622244 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.622247 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.622601 (+ 354us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.622837 (+ 236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.622838 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.622838 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.622915 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.623225 (+ 310us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.623232 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.623285 (+ 53us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.623378 (+ 93us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.623490 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":77,"threads_started":1}
I20260928 20:15:14.623605 31984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.614745 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48168 (local address 127.24.190.61:37251)
0928 20:15:14.614789 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.614791 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.614939 (+ 148us) server_negotiation.cc:407] Connection header received
0928 20:15:14.614998 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.614999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.615009 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.615078 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.615470 (+ 392us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.616262 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.617360 (+ 1098us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.617923 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.618005 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.620438 (+ 2433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.620440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.620440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.620447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.622111 (+ 1664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.622680 (+ 569us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.622681 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.622682 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.622747 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.622981 (+ 234us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.622982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.622982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.623135 (+ 153us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.623206 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.623420 (+ 214us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.623508 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:15:14.624449 31449 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.190.61:37251: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
member_type: NON_VOTER
last_known_addr {
host: "127.24.190.61"
port: 37251
}
attrs {
promote: true
}
}
dest_uuid: "22e220e8afec4b34b802a870f0044a65"
cas_config_opid_index: -1
I20260928 20:15:14.624775 31449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } }
I20260928 20:15:14.625339 32008 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } }
I20260928 20:15:14.625654 31955 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:14.626291 32008 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.190.61:37251
I20260928 20:15:14.626530 32007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } }
I20260928 20:15:14.626639 31913 master.cc:537] Master@127.24.190.61:37251 shutting down...
I20260928 20:15:14.626735 31955 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Refusing update from remote peer 22e220e8afec4b34b802a870f0044a65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260928 20:15:14.626699 32007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:14.627081 32007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:15:14.627894 31434 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260928 20:15:14.628319 31434 consensus_peers.cc:487] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 -> Peer c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61:37251): Couldn't send request to peer c8d6d3ca1f6648fc90f0b5512244ccca. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:15:14.629588 31913 raft_consensus.cc:2229] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:14.629694 31913 raft_consensus.cc:2258] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:14.629751 31913 tablet_replica.cc:330] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: stopping tablet replica
I20260928 20:15:14.632184 31913 master.cc:552] Master@127.24.190.61:37251 shutdown complete.
I20260928 20:15:14.632237 31913 master_runner.cc:305] Clearing existing system tablet
I20260928 20:15:14.632364 31913 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.632411 31913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.633106 31913 fs_manager.cc:709] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:14.633631 32012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.633780 31913 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.633841 31913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:14.633867 31913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "ebe922e3bd927c9479a7537fd3aedfda"
server_key_iv: "84229b125eb9f4ae2d63f625feaa6ee9"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.634647 31913 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:14.636487 31913 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260928 20:15:14.636569 31913 log.cc:1196] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260928 20:15:14.636778 31913 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Deleting consensus metadata
I20260928 20:15:14.636924 31913 master_runner.cc:315] Copying system tablet from 127.24.190.62:46561
I20260928 20:15:14.637571 31913 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: tablet copy: Beginning tablet copy session from remote peer at address 127.24.190.62:46561
I20260928 20:15:14.644460 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.637912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51604 (local address 127.24.190.62:46561)
0928 20:15:14.637965 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.637968 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.638036 (+ 68us) server_negotiation.cc:407] Connection header received
0928 20:15:14.638111 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.638112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.638120 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.638168 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.638591 (+ 423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.639104 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.640213 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.640470 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.640579 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.641751 (+ 1172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.641754 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.641754 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.641765 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.643336 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.643726 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.643727 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.643727 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.643780 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.643973 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.643973 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.643973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.644088 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.644142 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.644312 (+ 170us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.644392 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 20:15:14.644516 32018 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.637834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:51604)
0928 20:15:14.637962 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.637972 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.638045 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.638175 (+ 130us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.638176 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.638433 (+ 257us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.638503 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.638505 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.639189 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.639190 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.640011 (+ 821us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.640013 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.640599 (+ 586us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.640600 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.640685 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.641188 (+ 503us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.641193 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.641610 (+ 417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.643418 (+ 1808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.643419 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.643420 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.643646 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.643843 (+ 197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.643844 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.643845 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.643912 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.644156 (+ 244us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.644157 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.644217 (+ 60us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.644291 (+ 74us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.644406 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":91,"threads_started":1}
I20260928 20:15:14.645215 31469 tablet_copy_service.cc:140] P 22e220e8afec4b34b802a870f0044a65: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer c8d6d3ca1f6648fc90f0b5512244ccca ({username='oryx', principal='oryx/127.24.190.61@KRBTEST.COM'} at 127.0.0.1:51604)
I20260928 20:15:14.645324 31469 tablet_copy_service.cc:161] P 22e220e8afec4b34b802a870f0044a65: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer c8d6d3ca1f6648fc90f0b5512244ccca at {username='oryx', principal='oryx/127.24.190.61@KRBTEST.COM'} at 127.0.0.1:51604: session id = c8d6d3ca1f6648fc90f0b5512244ccca-00000000000000000000000000000000
I20260928 20:15:14.645967 31469 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Tablet Copy: opened 0 blocks and 1 log segments
I20260928 20:15:14.646940 31913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260928 20:15:14.648253 31913 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: tablet copy: Starting download of 0 data blocks...
I20260928 20:15:14.648407 31913 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: tablet copy: Starting download of 1 WAL segments...
I20260928 20:15:14.649291 31913 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260928 20:15:14.650223 31469 tablet_copy_service.cc:342] P 22e220e8afec4b34b802a870f0044a65: Request end of tablet copy session c8d6d3ca1f6648fc90f0b5512244ccca-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.190.61@KRBTEST.COM'} at 127.0.0.1:51604
I20260928 20:15:14.650312 31469 tablet_copy_service.cc:433] P 22e220e8afec4b34b802a870f0044a65: ending tablet copy session c8d6d3ca1f6648fc90f0b5512244ccca-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer c8d6d3ca1f6648fc90f0b5512244ccca
I20260928 20:15:14.653198 31913 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:14.654516 32020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.654807 31913 server_base.cc:1034] running on GCE node
W20260928 20:15:14.654961 32022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.655087 32019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.655233 31913 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:14.655373 31913 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:14.658592 31913 hybrid_clock.cc:648] HybridClock initialized: now 1790626514658585 us; error 32 us; skew 500 ppm
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:14.660606 31913 init.cc:377] Logged in from keytab as oryx/127.24.190.61@KRBTEST.COM (short username oryx)
I20260928 20:15:14.660894 31913 webserver.cc:460] Webserver started at http://127.24.190.61:41125/ using document root <none> and password file <none>
I20260928 20:15:14.661031 31913 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.661080 31913 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.661855 31913 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:14.662499 32029 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.662633 31913 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.662686 31913 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "ebe922e3bd927c9479a7537fd3aedfda"
server_key_iv: "84229b125eb9f4ae2d63f625feaa6ee9"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.662747 31913 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.681210 31913 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.683009 31913 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.686398 31913 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.61:37251
I20260928 20:15:14.686502 32081 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.61:37251 every 8 connection(s)
I20260928 20:15:14.686797 31913 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
I20260928 20:15:14.687534 32082 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:15:14.688169 32082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Bootstrap starting.
I20260928 20:15:14.690862 32082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:15:14.691107 32082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: Bootstrap complete.
I20260928 20:15:14.691315 32082 raft_consensus.cc:348] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } }
I20260928 20:15:14.691404 32082 raft_consensus.cc:729] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: c8d6d3ca1f6648fc90f0b5512244ccca, State: Initialized, Role: LEARNER
I20260928 20:15:14.691443 32082 consensus_queue.cc:260] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } }
I20260928 20:15:14.691606 32082 sys_catalog.cc:564] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:14.691612 32086 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } }
I20260928 20:15:14.691811 32086 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: LEARNER
I20260928 20:15:14.693336 32097 catalog_manager.cc:1259] Loaded cluster ID: 56e9fc06bd9d4c64961ac64fb818dd20
I20260928 20:15:14.693383 32097 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: loading cluster ID for follower catalog manager: success
I20260928 20:15:14.694772 32097 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: acquiring CA information for follower catalog manager: success
I20260928 20:15:14.695082 32097 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:15:14.696489 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.687992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48172 (local address 127.24.190.61:37251)
0928 20:15:14.689253 (+ 1261us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.689255 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.689264 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:14.689287 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.689288 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.689299 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.689398 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.689951 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.690689 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.691587 (+ 898us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.691880 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.691947 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.693514 (+ 1567us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.693515 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.693515 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.693522 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.695311 (+ 1789us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.695661 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.695663 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.695663 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.695719 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.695972 (+ 253us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.695973 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.695973 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.696081 (+ 108us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.696182 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.696310 (+ 128us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.696392 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1242,"thread_start_us":83,"threads_started":1}
WARNING: no policy specified for oryx/127.24.190.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.60@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.60.keytab.
Entry for principal oryx/127.24.190.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.60.keytab.
I20260928 20:15:14.721539 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:33543
--webserver_interface=127.24.190.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.60.keytab
--principal=oryx/127.24.190.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:14.803040 32100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:14.803314 32100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:14.803356 32100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:14.804553 32100 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:14.804616 32100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:14.804641 32100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:14.804672 32100 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:14.804701 32100 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:14.806196 32100 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.60.keytab
--principal=oryx/127.24.190.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:33543
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.190.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:14.806496 32100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:14.806728 32100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:14.811702 32108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.811689 32106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.811689 32105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.811892 32100 server_base.cc:1034] running on GCE node
I20260928 20:15:14.812218 32100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:14.812516 32100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:14.813683 32100 hybrid_clock.cc:648] HybridClock initialized: now 1790626514813667 us; error 45 us; skew 500 ppm
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:14.816156 32100 init.cc:377] Logged in from keytab as oryx/127.24.190.60@KRBTEST.COM (short username oryx)
I20260928 20:15:14.816743 32100 webserver.cc:460] Webserver started at http://127.24.190.60:42003/ using document root <none> and password file <none>
I20260928 20:15:14.817024 32100 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.817070 32100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.817216 32100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:14.818434 32100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/instance:
uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "113ce15347eb39da669c27a2686e7c09"
server_key_iv: "9d46c26d16b1af0514ec2488272f29f1"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.818794 32100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal/instance:
uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "113ce15347eb39da669c27a2686e7c09"
server_key_iv: "9d46c26d16b1af0514ec2488272f29f1"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.820083 32100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:14.820883 32115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.821139 32100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:14.821238 32100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "113ce15347eb39da669c27a2686e7c09"
server_key_iv: "9d46c26d16b1af0514ec2488272f29f1"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.821316 32100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.828768 32100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.830714 32100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:14.830870 32100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.835176 32100 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.60:33543
I20260928 20:15:14.835229 32167 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.60:33543 every 8 connection(s)
I20260928 20:15:14.835579 32100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
I20260928 20:15:14.836180 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 32100
I20260928 20:15:14.836807 32168 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:14.839454 32168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.190.60@KRBTEST.COM
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.60@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:14.847601 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.836812 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45658 (local address 127.24.190.60:33543)
0928 20:15:14.836998 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.837006 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.837034 (+ 28us) server_negotiation.cc:407] Connection header received
0928 20:15:14.837562 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.837571 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.837653 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.837859 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.838541 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.839955 (+ 1414us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.840758 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.841272 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.841347 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.843864 (+ 2517us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.843869 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.843870 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.843876 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.845668 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.846084 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.846087 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.846087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.846164 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.846447 (+ 283us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.846448 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.846448 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.846693 (+ 245us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.846807 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.847086 (+ 279us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.847318 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":142,"thread_start_us":74,"threads_started":1}
I20260928 20:15:14.848367 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.840089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:51612)
0928 20:15:14.840264 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.840306 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.840394 (+ 88us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.840536 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.840539 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.840877 (+ 338us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.840944 (+ 67us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.840946 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.841798 (+ 852us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.841799 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.842461 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.842463 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.842970 (+ 507us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.842971 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.843020 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.843513 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.843523 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.845245 (+ 1722us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.847157 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.847161 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.847163 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.847409 (+ 246us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.847618 (+ 209us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.847619 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.847619 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.847725 (+ 106us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.847996 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.848002 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.848049 (+ 47us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.848169 (+ 120us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.848288 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":91,"threads_started":1}
I20260928 20:15:14.848371 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.840229 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51612 (local address 127.24.190.62:46561)
0928 20:15:14.840278 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.840280 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.840381 (+ 101us) server_negotiation.cc:407] Connection header received
0928 20:15:14.840452 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.840453 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.840464 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.840510 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.841032 (+ 522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.841663 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.842543 (+ 880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.842857 (+ 314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.842934 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.845347 (+ 2413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.845348 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.845349 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.845355 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.847067 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.847491 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.847492 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.847493 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.847546 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.847789 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.847790 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.847790 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.847912 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.847992 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.848221 (+ 229us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.848303 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:15:14.848943 32168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.60@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:14.855417 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.849187 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:48176)
0928 20:15:14.849243 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.849254 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.849294 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.849441 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.849442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.849551 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.849600 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.849601 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.850174 (+ 573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.850174 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.850848 (+ 674us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.850851 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.851198 (+ 347us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.851199 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.851267 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.851753 (+ 486us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.851758 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.852917 (+ 1159us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.854543 (+ 1626us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.854544 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.854545 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.854724 (+ 179us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.854898 (+ 174us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.854898 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.854899 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.854948 (+ 49us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.855157 (+ 209us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.855158 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.855207 (+ 49us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.855265 (+ 58us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.855341 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":38}
I20260928 20:15:14.855418 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.849267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48176 (local address 127.24.190.61:37251)
0928 20:15:14.849333 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.849335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.849344 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:14.849374 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.849375 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.849383 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.849428 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.849649 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.850108 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.850923 (+ 815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.851120 (+ 197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.851179 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.852993 (+ 1814us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.852994 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.852994 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.853001 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.854472 (+ 1471us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.854792 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.854793 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.854793 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.854842 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.855003 (+ 161us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.855003 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.855004 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.855102 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.855152 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.855281 (+ 129us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.855355 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:15:14.855965 32168 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.60@KRBTEST.COM for oryx/127.24.190.60@KRBTEST.COM
I20260928 20:15:14.862533 32171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.856247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.0.0.1:45666)
0928 20:15:14.856297 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.856308 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.856356 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.856465 (+ 109us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.856466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.856580 (+ 114us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.856652 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.856653 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.857278 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.857280 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.857895 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.857898 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.858256 (+ 358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.858257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.858390 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.858834 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.858839 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.859983 (+ 1144us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.861297 (+ 1314us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.861298 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.861298 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.861465 (+ 167us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.861715 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.861715 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.861716 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.861784 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.862032 (+ 248us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.862033 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.862089 (+ 56us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.862228 (+ 139us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.862385 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260928 20:15:14.862588 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.856274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45666 (local address 127.24.190.60:33543)
0928 20:15:14.856325 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.856355 (+ 30us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.856363 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:14.856398 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.856399 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.856406 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.856451 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.856713 (+ 262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.857186 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.857977 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.858172 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.858223 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.860056 (+ 1833us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.860057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.860058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.860063 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.861229 (+ 1166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.861547 (+ 318us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.861548 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.861548 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.861593 (+ 45us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.861856 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.861856 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.861857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.861947 (+ 90us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.861995 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.862254 (+ 259us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.862455 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":69,"server-negotiator.queue_time_us":32}
I20260928 20:15:14.863957 32168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Bootstrap starting.
I20260928 20:15:14.864835 32168 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:14.865118 32168 log.cc:824] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:14.865839 32168 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: No bootstrap required, opened a new log
I20260928 20:15:14.867321 32168 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } }
I20260928 20:15:14.867476 32168 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:14.867524 32168 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7280935e2a7f4542bf8a7fd1d9d48639, State: Initialized, Role: FOLLOWER
I20260928 20:15:14.867660 32168 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } }
I20260928 20:15:14.867954 32168 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:14.867931 32173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } } }
I20260928 20:15:14.868068 32173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:15:14.869838 32184 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:15:14.869895 32184 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:15:14.872112 32100 master_runner.cc:428] Detected that this master 7280935e2a7f4542bf8a7fd1d9d48639 is joining an existing cluster
I20260928 20:15:14.872159 32100 master_runner.cc:432] Initiating AddMaster RPC to add 127.24.190.60:33543
I20260928 20:15:14.895602 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.873444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45676 (local address 127.24.190.60:33543)
0928 20:15:14.873485 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.873487 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.874694 (+ 1207us) server_negotiation.cc:407] Connection header received
0928 20:15:14.874773 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.874774 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.874781 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.874809 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.875242 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.875925 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876967 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.877232 (+ 265us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.877280 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.878407 (+ 1127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.878408 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.878408 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.878415 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.879753 (+ 1338us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.894821 (+ 15068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.894822 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.894822 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.894899 (+ 77us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.895079 (+ 180us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.895080 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.895080 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.895208 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.895269 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.895425 (+ 156us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.895503 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 20:15:14.895794 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.873205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51618 (local address 127.24.190.62:46561)
0928 20:15:14.873252 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.873254 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.873413 (+ 159us) server_negotiation.cc:407] Connection header received
0928 20:15:14.873604 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.873605 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.873623 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.873691 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.874070 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.874880 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876023 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.876316 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876358 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.877642 (+ 1284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.877643 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.877643 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.877651 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.879256 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.894815 (+ 15559us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.894817 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.894817 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.894899 (+ 82us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.895131 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.895132 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.895133 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.895276 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.895324 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.895582 (+ 258us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.895676 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:14.895990 32192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.873387 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.0.0.1:45676)
0928 20:15:14.874647 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.874655 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.874713 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.874882 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.874883 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.875100 (+ 217us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.875174 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.875175 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.875999 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.876877 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.876879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.877360 (+ 481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.877360 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.877434 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.877900 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.877905 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.878245 (+ 340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.879830 (+ 1585us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.879831 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.879832 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.894709 (+ 14877us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.894967 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.894968 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.894968 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.895018 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.895295 (+ 277us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.895296 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.895331 (+ 35us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.895801 (+ 470us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.895895 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1237,"mutex_wait_us":33,"thread_start_us":54,"threads_started":1}
I20260928 20:15:14.896750 32190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.873173 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:51618)
0928 20:15:14.873319 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.873336 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.873440 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.873703 (+ 263us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.873704 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.873895 (+ 191us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.873989 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.873990 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.874980 (+ 990us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.874981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.875919 (+ 938us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.875921 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.876446 (+ 525us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.876506 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.877010 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.877015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.877528 (+ 513us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.879328 (+ 1800us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.879329 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.879329 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.894687 (+ 15358us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.894988 (+ 301us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.894988 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.894989 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.895057 (+ 68us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.895416 (+ 359us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.895417 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.895461 (+ 44us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.896012 (+ 551us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.896123 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":69,"threads_started":1}
I20260928 20:15:14.899063 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.873524 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48178 (local address 127.24.190.61:37251)
0928 20:15:14.873565 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.873567 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.874531 (+ 964us) server_negotiation.cc:407] Connection header received
0928 20:15:14.874600 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.874601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.874612 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.874666 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.875111 (+ 445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.875903 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876969 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.877287 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.877326 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.895381 (+ 18055us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.895383 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.895384 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.895392 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.897501 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.897851 (+ 350us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.897853 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.897853 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.897919 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.898462 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.898464 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.898464 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.898628 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.898694 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.898899 (+ 205us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.898983 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:14.899412 32191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.873202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:48178)
0928 20:15:14.874462 (+ 1260us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.874475 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.874541 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.874709 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.874710 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.874960 (+ 250us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.875022 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.875024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.875999 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.876000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.876877 (+ 877us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.876879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.877393 (+ 514us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.877394 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.877450 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.894801 (+ 17351us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.894807 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.895278 (+ 471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.897589 (+ 2311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.897590 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.897590 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.897754 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.898284 (+ 530us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.898285 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.898285 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.898363 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.898721 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.898721 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.898766 (+ 45us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.899183 (+ 417us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.899300 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1238,"mutex_wait_us":44,"thread_start_us":68,"threads_started":1}
I20260928 20:15:14.899422 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31511
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626513, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.62@KRBTEST.COM for oryx/127.24.190.60@KRBTEST.COM
I20260928 20:15:14.906103 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.899068 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.0.0.1:45684)
0928 20:15:14.899191 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.899202 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.899240 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.899529 (+ 289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.899531 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.899694 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.899741 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.899742 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.900591 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.900592 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.901115 (+ 523us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.901117 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.901481 (+ 364us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.901483 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.901562 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.902010 (+ 448us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.902015 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.903477 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.905072 (+ 1595us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.905073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.905073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.905245 (+ 172us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.905463 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.905464 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.905465 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.905522 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.905774 (+ 252us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.905775 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.905820 (+ 45us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.905915 (+ 95us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.906012 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":102}
I20260928 20:15:14.906100 32170 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.899147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45684 (local address 127.24.190.60:33543)
0928 20:15:14.899375 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.899377 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.899384 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:15:14.899414 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.899415 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.899425 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.899473 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.899805 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.900512 (+ 707us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.901200 (+ 688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.901408 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.901484 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.903583 (+ 2099us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.903585 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.903585 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.903592 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.904969 (+ 1377us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.905337 (+ 368us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.905338 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.905339 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.905389 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.905602 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.905603 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.905603 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.905709 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.905781 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.905938 (+ 157us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.906010 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":211}
I20260928 20:15:14.907610 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:45995
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:46561
--webserver_port=43265
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:15:14.907614 31449 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.24.190.60:33543: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
member_type: NON_VOTER
last_known_addr {
host: "127.24.190.60"
port: 33543
}
attrs {
promote: true
}
}
dest_uuid: "22e220e8afec4b34b802a870f0044a65"
cas_config_opid_index: 5
I20260928 20:15:14.907866 31449 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } }
I20260928 20:15:14.908257 32008 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.908627 32142 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:14.909251 32008 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.24.190.60:33543
I20260928 20:15:14.909323 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.909385 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:14.909626 32142 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Refusing update from remote peer 22e220e8afec4b34b802a870f0044a65: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260928 20:15:14.909638 32100 master.cc:537] Master@127.24.190.60:33543 shutting down...
I20260928 20:15:14.909895 32007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:15:14.910845 31434 consensus_peers.cc:487] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 -> Peer 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60:33543): Couldn't send request to peer 7280935e2a7f4542bf8a7fd1d9d48639. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:15:14.912951 32100 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:14.913041 32100 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:14.913092 32100 tablet_replica.cc:330] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: stopping tablet replica
I20260928 20:15:14.914415 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.909466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48190 (local address 127.24.190.61:37251)
0928 20:15:14.909515 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.909517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.910434 (+ 917us) server_negotiation.cc:407] Connection header received
0928 20:15:14.910461 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.910462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.910487 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.910551 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:14.910720 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.911444 (+ 724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.913023 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.913725 (+ 702us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.913782 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.913850 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.914308 (+ 458us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.914350 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:15:14.914666 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.908363 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:48190)
0928 20:15:14.910302 (+ 1939us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.910314 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.910377 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.910586 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.910587 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.910589 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:14.910631 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.910633 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.911546 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.911547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.912917 (+ 1370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.912920 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.914074 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.914075 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.914151 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.914205 (+ 54us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.914554 (+ 349us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.914603 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1895}
I20260928 20:15:14.915091 32056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 LEARNER]: Refusing update from remote peer 22e220e8afec4b34b802a870f0044a65: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260928 20:15:14.915333 32007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260928 20:15:14.916002 32056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 LEARNER]: Committing config change with OpId 1.6: config changed from index 5 to 6, NON_VOTER 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60) added. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.917639 32086 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e220e8afec4b34b802a870f0044a65. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.917748 32086 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: LEARNER
I20260928 20:15:14.917798 32086 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: NON_VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: true } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.917881 32086 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: LEARNER
I20260928 20:15:14.918131 32007 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: attempting to promote NON_VOTER c8d6d3ca1f6648fc90f0b5512244ccca to VOTER
I20260928 20:15:14.918412 32007 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } }
W20260928 20:15:14.919238 31434 consensus_peers.cc:487] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 -> Peer 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60:33543): Couldn't send request to peer 7280935e2a7f4542bf8a7fd1d9d48639. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260928 20:15:14.919356 32056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 LEARNER]: Refusing update from remote peer 22e220e8afec4b34b802a870f0044a65: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260928 20:15:14.919548 32007 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260928 20:15:14.920194 32008 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.920326 32056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.921043 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.921110 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:14.921162 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.921202 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:14.921881 32195 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.922010 32195 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:15:14.933287 32100 master.cc:552] Master@127.24.190.60:33543 shutdown complete.
I20260928 20:15:14.933343 32100 master_runner.cc:305] Clearing existing system tablet
I20260928 20:15:14.933535 32100 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.933596 32100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.934465 32100 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:14.935004 32198 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.935175 32100 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.935292 32100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:14.935341 32100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "113ce15347eb39da669c27a2686e7c09"
server_key_iv: "9d46c26d16b1af0514ec2488272f29f1"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.936089 32100 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:14.937884 32100 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260928 20:15:14.937983 32100 log.cc:1196] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260928 20:15:14.938206 32100 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Deleting consensus metadata
I20260928 20:15:14.938448 32100 master_runner.cc:315] Copying system tablet from 127.24.190.62:46561
I20260928 20:15:14.939112 32100 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: tablet copy: Beginning tablet copy session from remote peer at address 127.24.190.62:46561
I20260928 20:15:14.946633 32204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.939416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:51630)
0928 20:15:14.939553 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:14.939573 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:14.939642 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:14.939876 (+ 234us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:14.939877 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:14.940084 (+ 207us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:14.940249 (+ 165us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.940252 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.941188 (+ 936us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.941189 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.942063 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:14.942066 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.942586 (+ 520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.942587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:14.942655 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.943173 (+ 518us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:14.943178 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:14.943573 (+ 395us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:14.945441 (+ 1868us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.945442 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.945442 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.945669 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.945900 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:14.945901 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:14.945901 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:14.945967 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:14.946262 (+ 295us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:14.946263 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:14.946347 (+ 84us) client_negotiation.cc:769] Sending connection context
0928 20:15:14.946423 (+ 76us) client_negotiation.cc:240] Negotiation successful
0928 20:15:14.946531 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":71,"threads_started":1}
I20260928 20:15:14.946638 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:14.939584 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51630 (local address 127.24.190.62:46561)
0928 20:15:14.939632 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:14.939634 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:14.939645 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:15:14.939776 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:14.939777 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:14.939788 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:14.939852 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:14.940337 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.941097 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.942183 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:14.942505 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:14.942577 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:14.943674 (+ 1097us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:14.943676 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:14.943676 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:14.943684 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:14.945355 (+ 1671us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.945753 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.945755 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.945755 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.945825 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:14.946039 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:14.946039 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:14.946040 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:14.946188 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:14.946259 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:14.946468 (+ 209us) server_negotiation.cc:299] Negotiation successful
0928 20:15:14.946549 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:14.947057 31469 tablet_copy_service.cc:140] P 22e220e8afec4b34b802a870f0044a65: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 7280935e2a7f4542bf8a7fd1d9d48639 ({username='oryx', principal='oryx/127.24.190.60@KRBTEST.COM'} at 127.0.0.1:51630)
I20260928 20:15:14.947117 31469 tablet_copy_service.cc:161] P 22e220e8afec4b34b802a870f0044a65: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 7280935e2a7f4542bf8a7fd1d9d48639 at {username='oryx', principal='oryx/127.24.190.60@KRBTEST.COM'} at 127.0.0.1:51630: session id = 7280935e2a7f4542bf8a7fd1d9d48639-00000000000000000000000000000000
I20260928 20:15:14.947671 31469 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Tablet Copy: opened 0 blocks and 1 log segments
I20260928 20:15:14.948187 32100 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260928 20:15:14.949458 32100 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: tablet copy: Starting download of 0 data blocks...
I20260928 20:15:14.949630 32100 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: tablet copy: Starting download of 1 WAL segments...
I20260928 20:15:14.950387 32100 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260928 20:15:14.951298 31469 tablet_copy_service.cc:342] P 22e220e8afec4b34b802a870f0044a65: Request end of tablet copy session 7280935e2a7f4542bf8a7fd1d9d48639-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.24.190.60@KRBTEST.COM'} at 127.0.0.1:51630
I20260928 20:15:14.951346 31469 tablet_copy_service.cc:433] P 22e220e8afec4b34b802a870f0044a65: ending tablet copy session 7280935e2a7f4542bf8a7fd1d9d48639-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 7280935e2a7f4542bf8a7fd1d9d48639
I20260928 20:15:14.954324 32100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:14.955773 32205 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:14.959313 32206 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.959650 32100 server_base.cc:1034] running on GCE node
W20260928 20:15:14.962440 32208 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:14.962625 32100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:14.962785 32100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:14.963985 32100 hybrid_clock.cc:648] HybridClock initialized: now 1790626514963981 us; error 58 us; skew 500 ppm
Sep 28 20:15:14 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626514, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:14.965528 32100 init.cc:377] Logged in from keytab as oryx/127.24.190.60@KRBTEST.COM (short username oryx)
I20260928 20:15:14.965849 32100 webserver.cc:460] Webserver started at http://127.24.190.60:44705/ using document root <none> and password file <none>
I20260928 20:15:14.966045 32100 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:14.966094 32100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:14.966949 32100 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:14.967586 32215 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:14.967837 32100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:14.967891 32100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "113ce15347eb39da669c27a2686e7c09"
server_key_iv: "9d46c26d16b1af0514ec2488272f29f1"
server_key_version: "encryptionkey@0"
I20260928 20:15:14.967953 32100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:14.985056 32100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:14.987005 32100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:14.990028 32100 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.60:33543
I20260928 20:15:14.990178 32267 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.60:33543 every 8 connection(s)
I20260928 20:15:14.990509 32100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
I20260928 20:15:14.991277 32268 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:15:14.991691 32268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Bootstrap starting.
I20260928 20:15:14.994256 32268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:15:14.994503 32268 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Bootstrap complete.
I20260928 20:15:14.994693 32268 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } }
I20260928 20:15:14.994778 32268 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 7280935e2a7f4542bf8a7fd1d9d48639, State: Initialized, Role: LEARNER
I20260928 20:15:14.994824 32268 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } }
I20260928 20:15:14.995025 32268 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:14.995100 32271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:14.995177 32271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: This master's current role is: LEARNER
I20260928 20:15:14.996776 32282 catalog_manager.cc:1259] Loaded cluster ID: 56e9fc06bd9d4c64961ac64fb818dd20
I20260928 20:15:14.996868 32282 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: loading cluster ID for follower catalog manager: success
I20260928 20:15:14.998162 32282 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: acquiring CA information for follower catalog manager: success
I20260928 20:15:14.998492 32282 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260928 20:15:15.013438 32193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:15.013998 32193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:15.014118 32193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:15.015880 32193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:15.015945 32193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:15.015987 32193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:15.018170 32193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:45995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=43265
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:15.018460 32193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:15.018729 32193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:15.024740 32290 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:15.024822 32287 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:15.024912 32193 server_base.cc:1034] running on GCE node
W20260928 20:15:15.024730 32288 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:15.025254 32193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:15.025498 32193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:15.026672 32193 hybrid_clock.cc:648] HybridClock initialized: now 1790626515026658 us; error 29 us; skew 500 ppm
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:15.029161 32193 init.cc:377] Logged in from keytab as oryx/127.24.190.1@KRBTEST.COM (short username oryx)
I20260928 20:15:15.029608 32193 webserver.cc:460] Webserver started at http://127.24.190.1:43265/ using document root <none> and password file <none>
I20260928 20:15:15.029842 32193 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:15.029922 32193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:15.031325 32193 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:15.031946 32297 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.032112 32193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:15.032207 32193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "52fb0c67626c49aabe124cc62e74b233"
format_stamp: "Formatted at 2026-09-28 20:15:13 on dist-test-slave-n45k"
server_key: "b9d00e55f197d9061e64bb65460b0090"
server_key_iv: "3b716622481892d36d2dc3e6df44be15"
server_key_version: "encryptionkey@0"
I20260928 20:15:15.032532 32193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:15.048695 32193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:15.051236 32193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:15.051393 32193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:15.051643 32193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:15.051988 32193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:15.052028 32193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.052052 32193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:15.052083 32193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.059175 32193 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:45995
I20260928 20:15:15.059264 32410 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:45995 every 8 connection(s)
I20260928 20:15:15.059621 32193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:15.065430 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 32193
I20260928 20:15:15.065598 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31645
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:15.070919 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.060891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:36039 (local address 127.24.190.61:37251)
0928 20:15:15.060936 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.060938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.061117 (+ 179us) server_negotiation.cc:407] Connection header received
0928 20:15:15.061492 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.061494 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.061508 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.061564 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.062577 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.063069 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.064508 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.064807 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.064876 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.067887 (+ 3011us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.067888 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.067889 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.067897 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.069417 (+ 1520us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.069855 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.069856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.069857 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.069916 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.070174 (+ 258us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.070175 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.070175 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.070362 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.070425 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.070766 (+ 341us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.070851 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 20:15:15.071465 32415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.060822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.24.190.1:36039)
0928 20:15:15.061062 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.061070 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.061365 (+ 295us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.061954 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.061955 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.062203 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.062471 (+ 268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.062476 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.063181 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.063182 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.064418 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.064420 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.064883 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.064884 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.065030 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.065704 (+ 674us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.065714 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.067771 (+ 2057us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.069511 (+ 1740us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.069517 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.069520 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.069760 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.069984 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.069985 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.069986 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.070105 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.070450 (+ 345us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.070456 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.070612 (+ 156us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.071035 (+ 423us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.071222 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":224,"thread_start_us":66,"threads_started":1}
I20260928 20:15:15.071928 32413 heartbeater.cc:347] Connected to a master server at 127.24.190.61:37251
I20260928 20:15:15.072036 32413 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.072209 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:45169
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:46561
--webserver_port=38041
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:15:15.072235 32413 heartbeater.cc:511] Master 127.24.190.61:37251 requested a full tablet report, sending...
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.60@KRBTEST.COM
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:15.073467 32046 ts_manager.cc:194] Registered new tserver with Master: 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995)
I20260928 20:15:15.076596 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.060471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:55521 (local address 127.24.190.62:46561)
0928 20:15:15.060657 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.060659 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.060822 (+ 163us) server_negotiation.cc:407] Connection header received
0928 20:15:15.061501 (+ 679us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.061502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.061513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.061545 (+ 32us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.063214 (+ 1669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.063956 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.064755 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.065050 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.065109 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.073526 (+ 8417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.073528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.073528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.073538 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.075299 (+ 1761us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.075653 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.075655 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.075655 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.075707 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.075909 (+ 202us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.075910 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.075911 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.076066 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.076137 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.076367 (+ 230us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.076459 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":158}
I20260928 20:15:15.076961 32417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.060533 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:49061 (local address 127.24.190.60:33543)
0928 20:15:15.061004 (+ 471us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.061006 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.061114 (+ 108us) server_negotiation.cc:407] Connection header received
0928 20:15:15.061545 (+ 431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.061546 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.061562 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.061623 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.064080 (+ 2457us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.064975 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.070346 (+ 5371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.070653 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.070728 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.073935 (+ 3207us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.073937 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.073937 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.073946 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.075778 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.076102 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.076103 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.076104 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.076161 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.076374 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.076375 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.076376 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.076514 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.076592 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.076777 (+ 185us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.076862 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":77,"threads_started":1}
I20260928 20:15:15.076974 32416 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.060481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:55521)
0928 20:15:15.060675 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.060720 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.061343 (+ 623us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.061649 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.061654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.062184 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.062471 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.062477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.064030 (+ 1553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.064031 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.064670 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.064672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.065109 (+ 437us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.065110 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.065228 (+ 118us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.072052 (+ 6824us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.072057 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.073414 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.075398 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.075399 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.075400 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.075569 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.075788 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.075789 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.075789 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.075849 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.076169 (+ 320us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.076170 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.076218 (+ 48us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.076698 (+ 480us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.076814 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"mutex_wait_us":6,"thread_start_us":109,"threads_started":1}
I20260928 20:15:15.077338 32418 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.060481 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.24.190.1:49061)
0928 20:15:15.061025 (+ 544us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.061036 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.061362 (+ 326us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.061664 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.061664 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.062184 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.062471 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.062477 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.065052 (+ 2575us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.065053 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.070228 (+ 5175us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.070231 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.070747 (+ 516us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.070748 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.070824 (+ 76us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.071252 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.071258 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.073860 (+ 2602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.075861 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.075862 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.075862 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.076031 (+ 169us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.076235 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.076236 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.076236 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.076291 (+ 55us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.076583 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.076584 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.076624 (+ 40us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.077061 (+ 437us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.077203 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"mutex_wait_us":33,"thread_start_us":111,"threads_started":1}
I20260928 20:15:15.077675 32411 heartbeater.cc:347] Connected to a master server at 127.24.190.60:33543
I20260928 20:15:15.077739 32411 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.077814 32412 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46561
I20260928 20:15:15.077819 32411 heartbeater.cc:511] Master 127.24.190.60:33543 requested a full tablet report, sending...
I20260928 20:15:15.077878 32412 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.077952 32412 heartbeater.cc:511] Master 127.24.190.62:46561 requested a full tablet report, sending...
I20260928 20:15:15.078213 31449 ts_manager.cc:194] Re-registered known tserver with Master: 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995)
I20260928 20:15:15.078208 32227 ts_manager.cc:194] Registered new tserver with Master: 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995)
I20260928 20:15:15.078611 31449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:55521
W20260928 20:15:15.158051 32419 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:15.158250 32419 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:15.158321 32419 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:15.159435 32419 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:15.159472 32419 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:15.159497 32419 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:15.160907 32419 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:45169
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=38041
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32419
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:15.161091 32419 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:15.161269 32419 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:15.166476 32427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:15.166604 32425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:15.166515 32424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:15.166498 32419 server_base.cc:1034] running on GCE node
I20260928 20:15:15.166922 32419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:15.167230 32419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:15.168392 32419 hybrid_clock.cc:648] HybridClock initialized: now 1790626515168366 us; error 40 us; skew 500 ppm
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:15.171005 32419 init.cc:377] Logged in from keytab as oryx/127.24.190.2@KRBTEST.COM (short username oryx)
I20260928 20:15:15.171515 32419 webserver.cc:460] Webserver started at http://127.24.190.2:38041/ using document root <none> and password file <none>
I20260928 20:15:15.171798 32419 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:15.171859 32419 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:15.173281 32419 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:15.173844 32434 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.174078 32419 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:15.174201 32419 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "16bc12e7f85f43439f943cb25f1bbda7"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "4a4dccb5e568a398a1b6e53cb8593ee5"
server_key_iv: "234894d1a118801eb3de1b3a7626395b"
server_key_version: "encryptionkey@0"
I20260928 20:15:15.174610 32419 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:15.200522 32419 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:15.202561 32419 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:15.202718 32419 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:15.202948 32419 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:15.203261 32419 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:15.203317 32419 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.203359 32419 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:15.203387 32419 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.209702 32419 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:45169
I20260928 20:15:15.209756 32547 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:45169 every 8 connection(s)
I20260928 20:15:15.210124 32419 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.60@KRBTEST.COM
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:15.217952 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 32419
I20260928 20:15:15.218106 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31779
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:15.221021 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.211233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:55903 (local address 127.24.190.61:37251)
0928 20:15:15.211277 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.211279 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.211381 (+ 102us) server_negotiation.cc:407] Connection header received
0928 20:15:15.211820 (+ 439us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.211821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.211833 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.211866 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.212576 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.213083 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214529 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.214825 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214893 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.217757 (+ 2864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.217758 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.217759 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.217767 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.219805 (+ 2038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.220194 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.220196 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.220196 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.220272 (+ 76us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.220467 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.220468 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.220468 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.220586 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.220624 (+ 38us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.220849 (+ 225us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.220927 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:15.221021 32417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.210859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:48829 (local address 127.24.190.60:33543)
0928 20:15:15.210937 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.210943 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.211292 (+ 349us) server_negotiation.cc:407] Connection header received
0928 20:15:15.211820 (+ 528us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.211821 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.211844 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.211875 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.212607 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.213338 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214551 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.214775 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214863 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.217393 (+ 2530us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.217395 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.217395 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.217402 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.219321 (+ 1919us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.219901 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.219902 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.219903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.219954 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.220286 (+ 332us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.220287 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.220287 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.220428 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.220472 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.220849 (+ 377us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.220931 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 20:15:15.221577 32554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.211158 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.24.190.2:55903)
0928 20:15:15.211331 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.211340 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.211725 (+ 385us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.211962 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.211966 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.212287 (+ 321us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.212465 (+ 178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.212472 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.213183 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.213183 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.214446 (+ 1263us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.214449 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.214946 (+ 497us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214947 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.215010 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.215828 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.215832 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.217649 (+ 1817us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.219892 (+ 2243us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.219893 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.219894 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.220094 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.220345 (+ 251us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.220346 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.220346 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.220396 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.220667 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.220667 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.220698 (+ 31us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.221148 (+ 450us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.221355 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":160,"mutex_wait_us":2,"thread_start_us":55,"threads_started":1}
I20260928 20:15:15.221897 32553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.210883 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.24.190.2:48829)
0928 20:15:15.211164 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.211207 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.211725 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.211961 (+ 236us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.211966 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.212486 (+ 520us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.212545 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.212547 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.213420 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.213421 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.214452 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.214453 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.214872 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214873 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.214995 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.215483 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.215493 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.217148 (+ 1655us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.219484 (+ 2336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.219491 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.219493 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.219811 (+ 318us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.220028 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.220029 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.220029 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.220181 (+ 152us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.220518 (+ 337us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.220524 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.220683 (+ 159us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.221516 (+ 833us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.221606 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":241,"mutex_wait_us":31,"thread_start_us":92,"threads_started":1}
I20260928 20:15:15.222959 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.211023 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:50973 (local address 127.24.190.62:46561)
0928 20:15:15.211078 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.211080 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.211287 (+ 207us) server_negotiation.cc:407] Connection header received
0928 20:15:15.211814 (+ 527us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.211815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.211828 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.211893 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.212559 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.213335 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.215245 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.215509 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.215592 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.219585 (+ 3993us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.219587 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.219587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.219595 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.221443 (+ 1848us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.222083 (+ 640us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.222084 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.222084 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.222146 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.222386 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.222387 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.222387 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.222554 (+ 167us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.222624 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.222807 (+ 183us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.222890 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:15:15.223088 32552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.210885 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:50973)
0928 20:15:15.211168 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.211208 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.211701 (+ 493us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.211966 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.211968 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.212276 (+ 308us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.212464 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.212468 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.214335 (+ 1867us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.214335 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.215155 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.215157 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.215595 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.215596 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.215670 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.216069 (+ 399us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.216074 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.219484 (+ 3410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.221582 (+ 2098us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.221583 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.221583 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.222001 (+ 418us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.222223 (+ 222us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.222224 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.222224 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.222331 (+ 107us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.222627 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.222628 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.222674 (+ 46us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.222749 (+ 75us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.222858 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":254,"mutex_wait_us":1,"thread_start_us":127,"threads_started":1}
I20260928 20:15:15.223541 32549 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46561
I20260928 20:15:15.223659 32549 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.223846 32549 heartbeater.cc:511] Master 127.24.190.62:46561 requested a full tablet report, sending...
I20260928 20:15:15.224236 31449 ts_manager.cc:194] Re-registered known tserver with Master: 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169)
I20260928 20:15:15.224641 31449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:50973
I20260928 20:15:15.225644 32548 heartbeater.cc:347] Connected to a master server at 127.24.190.60:33543
I20260928 20:15:15.225651 32550 heartbeater.cc:347] Connected to a master server at 127.24.190.61:37251
I20260928 20:15:15.225713 32548 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.225713 32550 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.225795 32548 heartbeater.cc:511] Master 127.24.190.60:33543 requested a full tablet report, sending...
I20260928 20:15:15.225797 32550 heartbeater.cc:511] Master 127.24.190.61:37251 requested a full tablet report, sending...
I20260928 20:15:15.225944 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:36439
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:46561
--webserver_port=37459
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35363
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:15:15.226083 32046 ts_manager.cc:194] Registered new tserver with Master: 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169)
I20260928 20:15:15.226099 32227 ts_manager.cc:194] Registered new tserver with Master: 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169)
W20260928 20:15:15.309005 32555 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:15.309204 32555 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:15.309228 32555 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:15.310362 32555 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:15.310415 32555 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:15.310452 32555 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:15.311898 32555 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35363
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:36439
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=37459
--tserver_master_addrs=127.24.190.62:46561,127.24.190.61:37251,127.24.190.60:33543
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.32555
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:15.312093 32555 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:15.312274 32555 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:15:15.317423 32555 server_base.cc:1034] running on GCE node
W20260928 20:15:15.317451 32561 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:15.317420 32560 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:15.317605 32563 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:15.317889 32555 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:15.318140 32555 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:15.319329 32555 hybrid_clock.cc:648] HybridClock initialized: now 1790626515319318 us; error 29 us; skew 500 ppm
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:15.321870 32555 init.cc:377] Logged in from keytab as oryx/127.24.190.3@KRBTEST.COM (short username oryx)
I20260928 20:15:15.322417 32555 webserver.cc:460] Webserver started at http://127.24.190.3:37459/ using document root <none> and password file <none>
I20260928 20:15:15.322662 32555 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:15.322718 32555 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:15.324091 32555 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:15.324668 32570 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.324879 32555 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:15.324983 32555 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f"
format_stamp: "Formatted at 2026-09-28 20:15:14 on dist-test-slave-n45k"
server_key: "a601c7fe836ae851c152a5d62ec94e79"
server_key_iv: "c3021377fae4e8c609c724ddd7a9a088"
server_key_version: "encryptionkey@0"
I20260928 20:15:15.325325 32555 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:15.348526 32555 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:15.351063 32555 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:15.351253 32555 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:15.351511 32555 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:15.351840 32555 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:15.351893 32555 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.351928 32555 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:15.351956 32555 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:15.357934 32555 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36439
I20260928 20:15:15.357969 32683 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36439 every 8 connection(s)
I20260928 20:15:15.358421 32555 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:15.361092 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 32555
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.60@KRBTEST.COM
I20260928 20:15:15.371312 32695 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.362699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54714 (local address 127.24.190.61:37251)
0928 20:15:15.363031 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.363033 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.363389 (+ 356us) server_negotiation.cc:407] Connection header received
0928 20:15:15.363495 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.363496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.363508 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.363566 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.364275 (+ 709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.364969 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.366079 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.366397 (+ 318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.366439 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.367996 (+ 1557us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.367997 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.367997 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.368004 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.369832 (+ 1828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.370368 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.370369 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.370369 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.370428 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.370655 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.370656 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.370656 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.370810 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.370890 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.371119 (+ 229us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.371197 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":302,"thread_start_us":52,"threads_started":1}
Sep 28 20:15:15 dist-test-slave-n45k krb5kdc[31404](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626515, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.61@KRBTEST.COM
I20260928 20:15:15.373697 32417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.359519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:36291 (local address 127.24.190.60:33543)
0928 20:15:15.359570 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.359572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.359783 (+ 211us) server_negotiation.cc:407] Connection header received
0928 20:15:15.360671 (+ 888us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.360672 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.360684 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.360731 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.361706 (+ 975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.362378 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364139 (+ 1761us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.364430 (+ 291us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364469 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.370464 (+ 5995us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.370466 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.370466 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.370474 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.372334 (+ 1860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372730 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.372731 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.372731 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.372784 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.373073 (+ 289us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.373074 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.373075 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.373200 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.373264 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.373508 (+ 244us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.373588 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:15:15.374117 32688 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.359152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:44789)
0928 20:15:15.359353 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.359397 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.360541 (+ 1144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.361063 (+ 522us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.361065 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.361351 (+ 286us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.361584 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.361589 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.362808 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.362809 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.364850 (+ 2041us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.364852 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.365347 (+ 495us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.365348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.365430 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.365799 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.365804 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.368386 (+ 2582us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.372118 (+ 3732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372126 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.372128 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.372432 (+ 304us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.372649 (+ 217us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372650 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.372650 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.372790 (+ 140us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.373094 (+ 304us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.373100 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.373275 (+ 175us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.373385 (+ 110us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.373853 (+ 468us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":17,"thread_start_us":84,"threads_started":1}
I20260928 20:15:15.374387 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.359445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.24.190.3:36291)
0928 20:15:15.359736 (+ 291us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.359744 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.360560 (+ 816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.360802 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.360806 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.361335 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.361586 (+ 251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.361592 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.362493 (+ 901us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.362494 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.364039 (+ 1545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.364042 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.364544 (+ 502us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.364670 (+ 125us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.365410 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.365420 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.370106 (+ 4686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.372417 (+ 2311us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372418 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.372418 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.372645 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.372872 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372872 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.372873 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.372936 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.373292 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.373293 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.373335 (+ 42us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.373404 (+ 69us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.374222 (+ 818us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":695,"thread_start_us":57,"threads_started":1}
I20260928 20:15:15.374455 31489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.359173 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:44789 (local address 127.24.190.62:46561)
0928 20:15:15.359229 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.359231 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.359550 (+ 319us) server_negotiation.cc:407] Connection header received
0928 20:15:15.360974 (+ 1424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.360975 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.360988 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.361041 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.361749 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.362588 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364922 (+ 2334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.365228 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.365291 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.368512 (+ 3221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.368513 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.368514 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.368521 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.372037 (+ 3516us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372512 (+ 475us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.372514 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.372514 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.372578 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.372864 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.372865 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.372866 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.373009 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.373068 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.374254 (+ 1186us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.374354 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 20:15:15.374845 32684 heartbeater.cc:347] Connected to a master server at 127.24.190.60:33543
I20260928 20:15:15.374941 32684 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.375141 32684 heartbeater.cc:511] Master 127.24.190.60:33543 requested a full tablet report, sending...
I20260928 20:15:15.375175 32685 heartbeater.cc:347] Connected to a master server at 127.24.190.62:46561
I20260928 20:15:15.375250 32685 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.375324 32685 heartbeater.cc:511] Master 127.24.190.62:46561 requested a full tablet report, sending...
I20260928 20:15:15.375556 31449 ts_manager.cc:194] Re-registered known tserver with Master: b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439)
I20260928 20:15:15.375568 32227 ts_manager.cc:194] Registered new tserver with Master: b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439)
I20260928 20:15:15.375902 32697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.362921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37082 (local address 127.24.190.60:33543)
0928 20:15:15.364968 (+ 2047us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.364969 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.364976 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:15:15.364994 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.364995 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.365005 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.365060 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.365819 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.366598 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.367598 (+ 1000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.367842 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.367918 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.369417 (+ 1499us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.369418 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.369419 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.369425 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.372081 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.373318 (+ 1237us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.373318 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.373319 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.373372 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.373578 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.373579 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.373580 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.374041 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.375694 (+ 1653us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.375735 (+ 41us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.375813 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2029,"thread_start_us":49,"threads_started":1}
I20260928 20:15:15.376051 31449 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:44789
I20260928 20:15:15.376546 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.359249 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:41051 (local address 127.24.190.61:37251)
0928 20:15:15.359293 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.359295 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.359739 (+ 444us) server_negotiation.cc:407] Connection header received
0928 20:15:15.360758 (+ 1019us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.360759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.360778 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.360820 (+ 42us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.361967 (+ 1147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.362700 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364113 (+ 1413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.364403 (+ 290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364466 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.373274 (+ 8808us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.373275 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.373276 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.373282 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.374984 (+ 1702us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.375388 (+ 404us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.375389 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.375390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.375453 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.375762 (+ 309us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.375763 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.375764 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.375911 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.375958 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.376389 (+ 431us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.376459 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:15.376564 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.359209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.24.190.3:41051)
0928 20:15:15.359631 (+ 422us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.359640 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.360541 (+ 901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.360825 (+ 284us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.360826 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.361828 (+ 1002us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:15.361879 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.361881 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.362818 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.362819 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.364022 (+ 1203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.364025 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.364525 (+ 500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.364526 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.364670 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.365602 (+ 932us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:15.365607 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:15.373172 (+ 7565us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:15.375077 (+ 1905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.375078 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.375078 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.375313 (+ 235us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.375558 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:15.375559 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:15.375559 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:15.375684 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:15.376235 (+ 551us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:15.376236 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:15.376287 (+ 51us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.376358 (+ 71us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.376460 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":400,"mutex_wait_us":1,"thread_start_us":82,"threads_started":1}
I20260928 20:15:15.377264 32686 heartbeater.cc:347] Connected to a master server at 127.24.190.61:37251
I20260928 20:15:15.377315 32686 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:15.377365 32686 heartbeater.cc:511] Master 127.24.190.61:37251 requested a full tablet report, sending...
I20260928 20:15:15.377619 32046 ts_manager.cc:194] Registered new tserver with Master: b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439)
I20260928 20:15:15.378681 32700 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.363275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59058 (local address 127.24.190.62:46561)
0928 20:15:15.365918 (+ 2643us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.365920 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.366027 (+ 107us) server_negotiation.cc:407] Connection header received
0928 20:15:15.366119 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.366120 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.366131 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.366170 (+ 39us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.369239 (+ 3069us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.370008 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.371181 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.371513 (+ 332us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.371552 (+ 39us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.373622 (+ 2070us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.373623 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.373623 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.373630 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.377198 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.377829 (+ 631us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.377830 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.377830 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.377890 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.378119 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.378127 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.378128 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.378240 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.378398 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.378501 (+ 103us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.378581 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2615,"thread_start_us":75,"threads_started":1}
I20260928 20:15:15.380461 31449 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59058:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:15.381932 31449 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:15.389768 32706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.385814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:45995 (local address 127.0.0.1:49412)
0928 20:15:15.385956 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.385963 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.386010 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.386763 (+ 753us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.386764 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.386766 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:15.386800 (+ 34us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.386801 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.387953 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.387954 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.388822 (+ 868us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.388824 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.389505 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.389506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.389569 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.389575 (+ 6us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.389645 (+ 70us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.389691 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":97,"threads_started":1}
I20260928 20:15:15.389794 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.386079 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49412 (local address 127.24.190.1:45995)
0928 20:15:15.386595 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.386600 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.386610 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:15.386648 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.386651 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.386668 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.386748 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:15.386865 (+ 117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.387874 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.388906 (+ 1032us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.389418 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.389507 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.389585 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.389686 (+ 101us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.389722 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":330,"thread_start_us":108,"threads_started":1}
I20260928 20:15:15.389947 32006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.385753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36439 (local address 127.0.0.1:54540)
0928 20:15:15.385800 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.385811 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.385849 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.386472 (+ 623us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.386474 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.386476 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:15.386527 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.386528 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.387784 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.387785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.388848 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.388850 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.389692 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.389693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.389761 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.389770 (+ 9us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.389800 (+ 30us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.389855 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29,"mutex_wait_us":14}
I20260928 20:15:15.389948 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.385822 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:45169 (local address 127.0.0.1:50310)
0928 20:15:15.386090 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.386099 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.386144 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.386478 (+ 334us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.386479 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.386481 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:15.386532 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.386534 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.387565 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.387566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.388764 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.388767 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.389698 (+ 931us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.389698 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.389762 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.389771 (+ 9us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.389800 (+ 29us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.389855 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":251,"mutex_wait_us":10,"thread_start_us":92,"threads_started":1}
I20260928 20:15:15.390419 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.385975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54540 (local address 127.24.190.3:36439)
0928 20:15:15.386289 (+ 314us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.386293 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.386302 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:15.386335 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.386337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.386353 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.386474 (+ 121us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:15.386622 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.387701 (+ 1079us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.388928 (+ 1227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.389599 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.390168 (+ 569us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.390255 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.390303 (+ 48us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.390342 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":257,"thread_start_us":74,"threads_started":1}
I20260928 20:15:15.390595 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.386066 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50310 (local address 127.24.190.2:45169)
0928 20:15:15.386227 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.386232 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.386243 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:15:15.386335 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.386337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.386353 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.386604 (+ 251us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:15.386671 (+ 67us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.387485 (+ 814us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.388859 (+ 1374us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.389606 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.390168 (+ 562us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.390255 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.390303 (+ 48us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.390342 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125,"thread_start_us":86,"threads_started":1}
I20260928 20:15:15.390755 32345 tablet_service.cc:1467] Processing CreateTablet for tablet d30215ef528947098b5cac4804707720 (DEFAULT_TABLE table=test-table [id=2d55802ec1fb4c878987250363596c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:15.391008 32618 tablet_service.cc:1467] Processing CreateTablet for tablet d30215ef528947098b5cac4804707720 (DEFAULT_TABLE table=test-table [id=2d55802ec1fb4c878987250363596c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:15.391176 32345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30215ef528947098b5cac4804707720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:15.391314 32618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30215ef528947098b5cac4804707720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:15.391203 32482 tablet_service.cc:1467] Processing CreateTablet for tablet d30215ef528947098b5cac4804707720 (DEFAULT_TABLE table=test-table [id=2d55802ec1fb4c878987250363596c65]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:15.391499 32482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30215ef528947098b5cac4804707720. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:15.394438 32710 tablet_bootstrap.cc:492] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Bootstrap starting.
I20260928 20:15:15.394865 32711 tablet_bootstrap.cc:492] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Bootstrap starting.
I20260928 20:15:15.395099 32712 tablet_bootstrap.cc:492] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Bootstrap starting.
I20260928 20:15:15.395279 32710 tablet_bootstrap.cc:654] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:15.395536 32711 tablet_bootstrap.cc:654] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:15.395638 32710 log.cc:824] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:15.395855 32712 tablet_bootstrap.cc:654] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:15.395893 32711 log.cc:824] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:15.396198 32712 log.cc:824] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:15.396548 32710 tablet_bootstrap.cc:492] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: No bootstrap required, opened a new log
I20260928 20:15:15.396593 32710 ts_tablet_manager.cc:1397] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:15.396673 32711 tablet_bootstrap.cc:492] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: No bootstrap required, opened a new log
I20260928 20:15:15.396730 32711 ts_tablet_manager.cc:1397] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:15.396957 32712 tablet_bootstrap.cc:492] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: No bootstrap required, opened a new log
I20260928 20:15:15.397008 32712 ts_tablet_manager.cc:1397] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:15.398602 32711 raft_consensus.cc:348] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.398731 32711 raft_consensus.cc:374] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:15.398752 32711 raft_consensus.cc:729] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bc12e7f85f43439f943cb25f1bbda7, State: Initialized, Role: FOLLOWER
I20260928 20:15:15.398870 32711 consensus_queue.cc:260] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.399163 32711 ts_tablet_manager.cc:1428] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:15:15.399236 32549 heartbeater.cc:503] Master 127.24.190.62:46561 was elected leader, sending a full tablet report...
I20260928 20:15:15.399190 32710 raft_consensus.cc:348] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.399336 32710 raft_consensus.cc:374] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:15.399590 32712 raft_consensus.cc:348] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.399744 32712 raft_consensus.cc:374] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:15.399775 32712 raft_consensus.cc:729] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52fb0c67626c49aabe124cc62e74b233, State: Initialized, Role: FOLLOWER
I20260928 20:15:15.399868 32712 consensus_queue.cc:260] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.400156 32712 ts_tablet_manager.cc:1428] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:15:15.400276 32412 heartbeater.cc:503] Master 127.24.190.62:46561 was elected leader, sending a full tablet report...
I20260928 20:15:15.399371 32710 raft_consensus.cc:729] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2a77f7a2a5c41f49c36bdc616c7a46f, State: Initialized, Role: FOLLOWER
I20260928 20:15:15.401257 32710 consensus_queue.cc:260] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.401603 32710 ts_tablet_manager.cc:1428] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Time spent starting tablet: real 0.005s user 0.003s sys 0.000s
I20260928 20:15:15.401722 32685 heartbeater.cc:503] Master 127.24.190.62:46561 was elected leader, sending a full tablet report...
I20260928 20:15:15.403826 32697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.400481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37094 (local address 127.24.190.60:33543)
0928 20:15:15.400570 (+ 89us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.400572 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.400580 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:15.400606 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.400607 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.400629 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.400700 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:15.400933 (+ 233us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.401673 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.403007 (+ 1334us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.403488 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.403582 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.403648 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.403719 (+ 71us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.403756 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260928 20:15:15.403826 32705 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.400167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.0.0.1:37094)
0928 20:15:15.400204 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.400216 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.400257 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.400793 (+ 536us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.400795 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.400796 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:15.400845 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.400847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.401772 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.401773 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.402944 (+ 1171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.402947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.403584 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.403585 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.403651 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.403656 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.403713 (+ 57us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.403756 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17}
I20260928 20:15:15.404238 32242 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.6->[1.7-1.9] Dedup: 1.7->[1.8-1.9]
I20260928 20:15:15.405093 32271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 22e220e8afec4b34b802a870f0044a65. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:15.405210 32271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: This master's current role is: LEARNER
W20260928 20:15:15.461040 32551 tablet.cc:2369] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:15.557408 32718 raft_consensus.cc:482] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:15.557560 32718 raft_consensus.cc:504] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.557951 32718 leader_election.cc:288] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995), 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169)
W20260928 20:15:15.560586 32414 tablet.cc:2369] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:15.561316 32690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.558408 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:45169 (local address 127.24.190.3:51269)
0928 20:15:15.558458 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.558469 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.558519 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.558690 (+ 171us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.558691 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.558692 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:15.558769 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.558770 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.559404 (+ 634us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.559405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.560152 (+ 747us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.560154 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.561000 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.561001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.561108 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.561113 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.561199 (+ 86us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.561247 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260928 20:15:15.561353 32708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.558197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:51269 (local address 127.24.190.2:45169)
0928 20:15:15.558261 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.558263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.558575 (+ 312us) server_negotiation.cc:407] Connection header received
0928 20:15:15.558611 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.558612 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.558622 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.558679 (+ 57us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:15.558847 (+ 168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.559319 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.560246 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.560778 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.560992 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.561005 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.561206 (+ 201us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.561246 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 20:15:15.561685 32502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30215ef528947098b5cac4804707720" candidate_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16bc12e7f85f43439f943cb25f1bbda7" is_pre_election: true
I20260928 20:15:15.561826 32502 raft_consensus.cc:2454] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2a77f7a2a5c41f49c36bdc616c7a46f in term 0.
I20260928 20:15:15.562085 32573 leader_election.cc:302] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16bc12e7f85f43439f943cb25f1bbda7, b2a77f7a2a5c41f49c36bdc616c7a46f; no voters:
I20260928 20:15:15.562252 32718 raft_consensus.cc:2781] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:15.562325 32718 raft_consensus.cc:482] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:15.562357 32718 raft_consensus.cc:3037] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:15.562757 32689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.558301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:45995 (local address 127.24.190.3:48055)
0928 20:15:15.558384 (+ 83us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:15.558397 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:15.558450 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:15.558601 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:15.558602 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:15.558604 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:15.558816 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.558819 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.559842 (+ 1023us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.559843 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.561442 (+ 1599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:15.561445 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.562477 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.562478 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:15.562564 (+ 86us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.562569 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:15.562618 (+ 49us) client_negotiation.cc:240] Negotiation successful
0928 20:15:15.562668 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60,"mutex_wait_us":16}
I20260928 20:15:15.563136 32709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.558416 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48055 (local address 127.24.190.1:45995)
0928 20:15:15.558461 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.558463 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.558475 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:15:15.558508 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.558509 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.558519 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.558578 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:15.558911 (+ 333us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.559742 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.561568 (+ 1826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.562358 (+ 790us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.562433 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.562442 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.562991 (+ 549us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.563047 (+ 56us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:15:15.563356 32718 raft_consensus.cc:504] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.563517 32718 leader_election.cc:288] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [CANDIDATE]: Term 1 election: Requested vote from peers 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995), 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169)
I20260928 20:15:15.563792 32365 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30215ef528947098b5cac4804707720" candidate_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52fb0c67626c49aabe124cc62e74b233" is_pre_election: true
I20260928 20:15:15.563987 32365 raft_consensus.cc:2454] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2a77f7a2a5c41f49c36bdc616c7a46f in term 0.
I20260928 20:15:15.563792 32364 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30215ef528947098b5cac4804707720" candidate_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "52fb0c67626c49aabe124cc62e74b233"
I20260928 20:15:15.564103 32364 raft_consensus.cc:3037] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:15.564762 32364 raft_consensus.cc:2454] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2a77f7a2a5c41f49c36bdc616c7a46f in term 1.
I20260928 20:15:15.564870 32502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30215ef528947098b5cac4804707720" candidate_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16bc12e7f85f43439f943cb25f1bbda7"
I20260928 20:15:15.564955 32502 raft_consensus.cc:3037] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:15.565623 32502 raft_consensus.cc:2454] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2a77f7a2a5c41f49c36bdc616c7a46f in term 1.
I20260928 20:15:15.565907 32571 leader_election.cc:302] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52fb0c67626c49aabe124cc62e74b233, b2a77f7a2a5c41f49c36bdc616c7a46f; no voters:
I20260928 20:15:15.566028 32718 raft_consensus.cc:2781] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:15.566211 32718 raft_consensus.cc:686] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 LEADER]: Becoming Leader. State: Replica: b2a77f7a2a5c41f49c36bdc616c7a46f, State: Running, Role: LEADER
I20260928 20:15:15.566398 32718 consensus_queue.cc:237] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } }
I20260928 20:15:15.567386 31449 catalog_manager.cc:5495] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f reported cstate change: term changed from 0 to 1, leader changed from <none> to b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3). New cstate: current_term: 1 leader_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:15.568014 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: NON_VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: true } } }
I20260928 20:15:15.568126 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:15.569005 32196 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: attempting to promote NON_VOTER 7280935e2a7f4542bf8a7fd1d9d48639 to VOTER
I20260928 20:15:15.569152 32196 consensus_queue.cc:237] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 1.10, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:15.569703 32056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Refusing update from remote peer 22e220e8afec4b34b802a870f0044a65: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260928 20:15:15.569787 32241 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 LEARNER]: Refusing update from remote peer 22e220e8afec4b34b802a870f0044a65: Log matching property violated. Preceding OpId in replica: term: 1 index: 10. Preceding OpId from leader: term: 1 index: 11. (index mismatch)
I20260928 20:15:15.569990 32726 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260928 20:15:15.570104 32008 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260928 20:15:15.570662 32007 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [term 1 LEADER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.571460 32007 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.571544 32007 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:15.571472 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.571652 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:15.571871 32008 sys_catalog.cc:455] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.571995 32008 sys_catalog.cc:458] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:15.572242 32241 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.572253 32056 raft_consensus.cc:2932] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Committing config change with OpId 1.11: config changed from index 7 to 11, 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.573169 32271 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.573263 32271 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:15:15.573414 32727 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "22e220e8afec4b34b802a870f0044a65" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:15.573519 32727 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:15:15.579385 32707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.576500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54552 (local address 127.24.190.3:36439)
0928 20:15:15.576547 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.576549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.576560 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:15:15.576598 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.576598 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.576640 (+ 42us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.576724 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:15.576917 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.577623 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.578528 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.578796 (+ 268us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.578878 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.579059 (+ 181us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:15.579169 (+ 110us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:15.579264 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.579283 (+ 19us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.579305 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:15:15.581125 32502 raft_consensus.cc:1261] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Refusing update from remote peer b2a77f7a2a5c41f49c36bdc616c7a46f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:15.581152 32364 raft_consensus.cc:1261] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Refusing update from remote peer b2a77f7a2a5c41f49c36bdc616c7a46f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:15.581496 32723 consensus_queue.cc:1035] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [LEADER]: Connected to new peer: Peer: permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:15.581650 32718 consensus_queue.cc:1035] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [LEADER]: Connected to new peer: Peer: permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:15.584625 32729 mvcc.cc:205] Tried to move back new op lower bound from 7334406207817445376 to 7334406207760715776. Current Snapshot: MvccSnapshot[applied={T|T < 7334406207817445376}]
I20260928 20:15:15.586521 32731 mvcc.cc:205] Tried to move back new op lower bound from 7334406207817445376 to 7334406207760715776. Current Snapshot: MvccSnapshot[applied={T|T < 7334406207817445376}]
I20260928 20:15:15.588835 31449 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:15.588943 31449 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59058:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:15.590758 31449 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 22e220e8afec4b34b802a870f0044a65: Sending DeleteTablet for 3 replicas of tablet d30215ef528947098b5cac4804707720
I20260928 20:15:15.591085 32345 tablet_service.cc:1514] Processing DeleteTablet for tablet d30215ef528947098b5cac4804707720 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:15 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:49412
I20260928 20:15:15.591146 32482 tablet_service.cc:1514] Processing DeleteTablet for tablet d30215ef528947098b5cac4804707720 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:15 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50310
I20260928 20:15:15.591168 32618 tablet_service.cc:1514] Processing DeleteTablet for tablet d30215ef528947098b5cac4804707720 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:15 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:54540
I20260928 20:15:15.591377 32739 tablet_replica.cc:330] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: stopping tablet replica
I20260928 20:15:15.591552 32739 raft_consensus.cc:2229] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:15.591747 32739 raft_consensus.cc:2258] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:15.592314 32739 ts_tablet_manager.cc:1905] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:15.592765 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31417
I20260928 20:15:15.595057 32739 ts_tablet_manager.cc:1918] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:15.595232 32739 log.cc:1196] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/d30215ef528947098b5cac4804707720
I20260928 20:15:15.595571 32739 ts_tablet_manager.cc:1939] T d30215ef528947098b5cac4804707720 P b2a77f7a2a5c41f49c36bdc616c7a46f: Deleting consensus metadata
I20260928 20:15:15.595978 32740 tablet_replica.cc:330] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: stopping tablet replica
I20260928 20:15:15.596189 32740 raft_consensus.cc:2229] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:15.596316 32740 raft_consensus.cc:2258] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260928 20:15:15.600219 32573 connection.cc:535] server connection from 127.0.0.1:54540 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 20:15:15.604676 32697 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.592196 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37096 (local address 127.24.190.60:33543)
0928 20:15:15.592242 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.592246 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.596024 (+ 3778us) server_negotiation.cc:407] Connection header received
0928 20:15:15.596363 (+ 339us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.596364 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.596377 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.596407 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.597324 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.598167 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.599355 (+ 1188us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.599694 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.599739 (+ 45us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.601534 (+ 1795us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.601536 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.601536 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.601544 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.603433 (+ 1889us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.603831 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.603832 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.603832 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.603887 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.604080 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.604081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.604081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.604199 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.604270 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.604490 (+ 220us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.604573 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:15.606540 32738 tablet_replica.cc:330] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: stopping tablet replica
I20260928 20:15:15.606732 32740 ts_tablet_manager.cc:1905] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:15.606775 32738 raft_consensus.cc:2229] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:15.606999 32738 raft_consensus.cc:2258] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:15.607553 32738 ts_tablet_manager.cc:1905] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:15.608476 32740 ts_tablet_manager.cc:1918] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:15.608577 32740 log.cc:1196] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/d30215ef528947098b5cac4804707720
I20260928 20:15:15.608871 32740 ts_tablet_manager.cc:1939] T d30215ef528947098b5cac4804707720 P 16bc12e7f85f43439f943cb25f1bbda7: Deleting consensus metadata
W20260928 20:15:15.609332 32436 connection.cc:441] server connection from 127.0.0.1:50310 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:50310 (request call id 1) could send its response
I20260928 20:15:15.609534 32738 ts_tablet_manager.cc:1918] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:15.609689 32738 log.cc:1196] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/d30215ef528947098b5cac4804707720
I20260928 20:15:15.610041 32738 ts_tablet_manager.cc:1939] T d30215ef528947098b5cac4804707720 P 52fb0c67626c49aabe124cc62e74b233: Deleting consensus metadata
W20260928 20:15:15.610486 32298 connection.cc:441] server connection from 127.0.0.1:49412 torn down before Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:49412 (request call id 1) could send its response
I20260928 20:15:15.610986 32084 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.602326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54718 (local address 127.24.190.61:37251)
0928 20:15:15.602374 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.602376 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.602899 (+ 523us) server_negotiation.cc:407] Connection header received
0928 20:15:15.603032 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.603033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.603044 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.603074 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.603733 (+ 659us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.604484 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.605481 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.605725 (+ 244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.605759 (+ 34us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.607721 (+ 1962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.607722 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.607723 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.607730 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.609451 (+ 1721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.609886 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.609888 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.609888 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.609944 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.610189 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.610190 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.610190 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.610347 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.610429 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.610791 (+ 362us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.610875 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:15:15.617259 32417 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:15.602647 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37102 (local address 127.24.190.60:33543)
0928 20:15:15.602689 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:15.602691 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:15.610608 (+ 7917us) server_negotiation.cc:407] Connection header received
0928 20:15:15.610748 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:15.610750 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:15.610761 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:15.610792 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:15.611689 (+ 897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.612166 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.612816 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:15.613025 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:15.613117 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:15.614388 (+ 1271us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:15.614389 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:15.614390 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:15.614396 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:15.616047 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.616419 (+ 372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.616420 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.616421 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.616484 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:15.616697 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:15.616698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:15.616698 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:15.616823 (+ 125us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:15.616940 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:15.617061 (+ 121us) server_negotiation.cc:299] Negotiation successful
0928 20:15:15.617132 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:15:16.586162 32748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:16.585841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:38483)
0928 20:15:16.585991 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:16.586068 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":65,"threads_started":1}
W20260928 20:15:16.586508 32549 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:46561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:16.586747 32749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:16.586487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:37747)
0928 20:15:16.586587 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:16.586677 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":86,"thread_start_us":47,"threads_started":1}
W20260928 20:15:16.586956 32412 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:46561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:16.587548 32750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:16.587310 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:60729)
0928 20:15:16.587417 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:16.587499 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":91,"thread_start_us":54,"threads_started":1}
W20260928 20:15:16.587759 32685 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:46561 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:17.091710 32752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22e220e8afec4b34b802a870f0044a65)
I20260928 20:15:17.091710 32751 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 22e220e8afec4b34b802a870f0044a65)
I20260928 20:15:17.091902 32751 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:17.091905 32752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:17.092254 32752 leader_election.cc:288] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561), c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61:37251)
I20260928 20:15:17.092494 32751 leader_election.cc:288] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561), 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60:33543)
I20260928 20:15:17.092612 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.092383 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59508)
0928 20:15:17.092494 (+ 111us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.092540 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":51,"threads_started":1}
W20260928 20:15:17.092785 32033 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:17.093210 32759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.092997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59514)
0928 20:15:17.093113 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.093168 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":45,"threads_started":1}
I20260928 20:15:17.093267 32754 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.093134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59516)
0928 20:15:17.093172 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.093206 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
W20260928 20:15:17.093391 32219 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
W20260928 20:15:17.093597 32033 leader_election.cc:334] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:17.093847 32759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.093751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59522)
0928 20:15:17.093798 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.093824 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 20:15:17.093968 32219 leader_election.cc:334] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:17.095925 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.092460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:37251 (local address 127.0.0.1:54734)
0928 20:15:17.092601 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.092612 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:17.092676 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:17.092972 (+ 296us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:17.092973 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:17.092976 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:17.093038 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:17.093040 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.094067 (+ 1027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.094068 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:17.094900 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:17.094902 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.095659 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.095660 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:17.095726 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:17.095729 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:17.095803 (+ 74us) client_negotiation.cc:240] Negotiation successful
0928 20:15:17.095846 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":51,"threads_started":1}
I20260928 20:15:17.095937 32757 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.092597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54734 (local address 127.24.190.61:37251)
0928 20:15:17.092828 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:17.092830 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:17.092837 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:15:17.092860 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:17.092861 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:17.092872 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:17.092944 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:17.093135 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.093990 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.095004 (+ 1014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.095572 (+ 568us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.095657 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:17.095667 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:17.095810 (+ 143us) server_negotiation.cc:299] Negotiation successful
0928 20:15:17.095850 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":217,"thread_start_us":51,"threads_started":1}
I20260928 20:15:17.095945 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.092406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:33543 (local address 127.0.0.1:37114)
0928 20:15:17.092722 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.092732 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:17.092795 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:17.093020 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:17.093020 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:17.093022 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:17.093066 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:17.093068 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.094060 (+ 992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.094061 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:17.094993 (+ 932us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:17.094995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.095661 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.095662 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:17.095739 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:17.095744 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:17.095816 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:15:17.095859 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":307,"thread_start_us":40,"threads_started":1}
I20260928 20:15:17.095940 32756 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.092538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37114 (local address 127.24.190.60:33543)
0928 20:15:17.092638 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:17.092641 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:17.092786 (+ 145us) server_negotiation.cc:407] Connection header received
0928 20:15:17.092909 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:17.092910 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:17.092920 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:17.092956 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:17.093146 (+ 190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.093952 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.095084 (+ 1132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:17.095569 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:17.095658 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:17.095669 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:17.095822 (+ 153us) server_negotiation.cc:299] Negotiation successful
0928 20:15:17.095861 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81,"thread_start_us":33,"threads_started":1}
I20260928 20:15:17.096356 32056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" is_pre_election: true
I20260928 20:15:17.096390 32241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" is_pre_election: true
I20260928 20:15:17.096478 32056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7280935e2a7f4542bf8a7fd1d9d48639 in term 1.
I20260928 20:15:17.096485 32241 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8d6d3ca1f6648fc90f0b5512244ccca in term 1.
I20260928 20:15:17.096634 32031 leader_election.cc:302] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7280935e2a7f4542bf8a7fd1d9d48639, c8d6d3ca1f6648fc90f0b5512244ccca; no voters: 22e220e8afec4b34b802a870f0044a65
I20260928 20:15:17.096709 32217 leader_election.cc:302] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7280935e2a7f4542bf8a7fd1d9d48639, c8d6d3ca1f6648fc90f0b5512244ccca; no voters: 22e220e8afec4b34b802a870f0044a65
I20260928 20:15:17.096776 32751 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:15:17.096812 32751 raft_consensus.cc:482] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22e220e8afec4b34b802a870f0044a65)
I20260928 20:15:17.096825 32752 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260928 20:15:17.096843 32751 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:15:17.096854 32752 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 22e220e8afec4b34b802a870f0044a65)
I20260928 20:15:17.096876 32752 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:15:17.097530 32752 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:17.097576 32751 raft_consensus.cc:504] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 2 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:17.097669 32752 leader_election.cc:288] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 2 election: Requested vote from peers 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561), c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61:37251)
I20260928 20:15:17.097771 32751 leader_election.cc:288] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [CANDIDATE]: Term 2 election: Requested vote from peers 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561), 7280935e2a7f4542bf8a7fd1d9d48639 (127.24.190.60:33543)
I20260928 20:15:17.097898 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.097794 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59538)
0928 20:15:17.097833 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.097864 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260928 20:15:17.097878 32056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
I20260928 20:15:17.097923 32241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "7280935e2a7f4542bf8a7fd1d9d48639"
I20260928 20:15:17.097988 32056 raft_consensus.cc:2379] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7280935e2a7f4542bf8a7fd1d9d48639 in current term 2: Already voted for candidate c8d6d3ca1f6648fc90f0b5512244ccca in this term.
I20260928 20:15:17.098013 32241 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c8d6d3ca1f6648fc90f0b5512244ccca in current term 2: Already voted for candidate 7280935e2a7f4542bf8a7fd1d9d48639 in this term.
I20260928 20:15:17.098340 32753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.098217 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59552)
0928 20:15:17.098246 (+ 29us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.098314 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
W20260928 20:15:17.098393 32033 leader_election.cc:334] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:17.098394 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.098258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59532)
0928 20:15:17.098334 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.098368 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260928 20:15:17.098420 32033 leader_election.cc:302] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8d6d3ca1f6648fc90f0b5512244ccca; no voters: 22e220e8afec4b34b802a870f0044a65, 7280935e2a7f4542bf8a7fd1d9d48639
I20260928 20:15:17.098481 32751 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:15:17.098848 32755 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.098726 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59562)
0928 20:15:17.098764 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.098786 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260928 20:15:17.098977 32219 leader_election.cc:334] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:17.099052 32219 leader_election.cc:302] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7280935e2a7f4542bf8a7fd1d9d48639; no voters: 22e220e8afec4b34b802a870f0044a65, c8d6d3ca1f6648fc90f0b5512244ccca
I20260928 20:15:17.099118 32752 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260928 20:15:17.587419 32761 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.586990 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:41479)
0928 20:15:17.587312 (+ 322us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.587356 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":303,"thread_start_us":262,"threads_started":1}
I20260928 20:15:17.587539 32762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.587335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:41659)
0928 20:15:17.587455 (+ 120us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.587489 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":55,"threads_started":1}
I20260928 20:15:17.588217 32763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:17.588024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:33751)
0928 20:15:17.588157 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:17.588185 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":54,"threads_started":1}
I20260928 20:15:18.588513 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.588269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:57187)
0928 20:15:18.588407 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.588451 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":70,"threads_started":1}
I20260928 20:15:18.588862 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.588317 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:53369)
0928 20:15:18.588762 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.588802 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":427,"thread_start_us":58,"threads_started":1}
I20260928 20:15:18.589129 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.588834 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:37533)
0928 20:15:18.589043 (+ 209us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.589081 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":50,"threads_started":1}
I20260928 20:15:18.867990 32767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:18.868101 32767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:18.868309 32767 leader_election.cc:288] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561), c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61:37251)
I20260928 20:15:18.868551 32056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" is_pre_election: true
I20260928 20:15:18.868664 32056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7280935e2a7f4542bf8a7fd1d9d48639 in term 2.
I20260928 20:15:18.868702 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.868475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59828)
0928 20:15:18.868591 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.868638 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":74,"threads_started":1}
I20260928 20:15:18.868827 32217 leader_election.cc:302] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7280935e2a7f4542bf8a7fd1d9d48639, c8d6d3ca1f6648fc90f0b5512244ccca; no voters:
I20260928 20:15:18.868942 32767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260928 20:15:18.868992 32767 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:18.869029 32767 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:15:18.869158 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.869044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59838)
0928 20:15:18.869091 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.869126 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260928 20:15:18.869365 32219 leader_election.cc:334] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:18.869933 32767 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:18.870079 32767 leader_election.cc:288] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 3 election: Requested vote from peers 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561), c8d6d3ca1f6648fc90f0b5512244ccca (127.24.190.61:37251)
I20260928 20:15:18.870254 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.870145 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59848)
0928 20:15:18.870184 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.870225 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
I20260928 20:15:18.870242 32056 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca"
I20260928 20:15:18.870376 32056 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:15:18.870630 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.870532 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59856)
0928 20:15:18.870582 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.870607 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260928 20:15:18.870724 32219 leader_election.cc:334] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
I20260928 20:15:18.871134 32056 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7280935e2a7f4542bf8a7fd1d9d48639 in term 3.
I20260928 20:15:18.871335 32217 leader_election.cc:302] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7280935e2a7f4542bf8a7fd1d9d48639, c8d6d3ca1f6648fc90f0b5512244ccca; no voters: 22e220e8afec4b34b802a870f0044a65
I20260928 20:15:18.871440 32767 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 3 FOLLOWER]: Leader election won for term 3
I20260928 20:15:18.871572 32767 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [term 3 LEADER]: Becoming Leader. State: Replica: 7280935e2a7f4542bf8a7fd1d9d48639, State: Running, Role: LEADER
I20260928 20:15:18.871663 32767 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } }
I20260928 20:15:18.872059 302 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7280935e2a7f4542bf8a7fd1d9d48639. Latest consensus state: current_term: 3 leader_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:18.872282 302 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:18.872445 304 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:18.872843 304 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:18.872898 304 catalog_manager.cc:1259] Loaded cluster ID: 56e9fc06bd9d4c64961ac64fb818dd20
I20260928 20:15:18.872915 304 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:18.873044 304 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:18.873095 304 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Loaded TSK: 0
I20260928 20:15:18.873186 304 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:15:18.937359 32232 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37102:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:18.938971 32232 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:18.940029 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.939889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59872)
0928 20:15:18.939955 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.939993 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
I20260928 20:15:18.940042 32056 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [term 3 FOLLOWER]: Refusing update from remote peer 7280935e2a7f4542bf8a7fd1d9d48639: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260928 20:15:18.940447 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.940280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.0.0.1:59874)
0928 20:15:18.940396 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.940426 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260928 20:15:18.940394 302 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260928 20:15:18.940573 32219 consensus_peers.cc:487] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 -> Peer 22e220e8afec4b34b802a870f0044a65 (127.24.190.62:46561): Couldn't send request to peer 22e220e8afec4b34b802a870f0044a65. Status: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260928 20:15:18.940982 306 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7280935e2a7f4542bf8a7fd1d9d48639. Latest consensus state: current_term: 3 leader_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:18.941062 306 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:15:18.941461 305 mvcc.cc:205] Tried to move back new op lower bound from 7334406221576175616 to 7334406221299060736. Current Snapshot: MvccSnapshot[applied={T|T < 7334406221576175616}]
I20260928 20:15:18.941577 32767 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:18.941675 32767 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:18.941865 306 sys_catalog.cc:455] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" committed_config { opid_index: 11 OBSOLETE_local: true peers { permanent_uuid: "22e220e8afec4b34b802a870f0044a65" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46561 } } peers { permanent_uuid: "c8d6d3ca1f6648fc90f0b5512244ccca" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 37251 } attrs { promote: false } } peers { permanent_uuid: "7280935e2a7f4542bf8a7fd1d9d48639" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 33543 } attrs { promote: false } } }
I20260928 20:15:18.941972 306 sys_catalog.cc:458] T 00000000000000000000000000000000 P c8d6d3ca1f6648fc90f0b5512244ccca [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:15:18.946902 312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.943487 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:45995 (local address 127.0.0.1:49414)
0928 20:15:18.943713 (+ 226us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.943725 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:18.943778 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:18.944516 (+ 738us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:18.944516 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:18.944518 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:18.944554 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.944555 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.945186 (+ 631us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.945187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.945923 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.945924 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.946637 (+ 713us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.946638 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.946699 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.946704 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:18.946779 (+ 75us) client_negotiation.cc:240] Negotiation successful
0928 20:15:18.946820 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206}
I20260928 20:15:18.946893 314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.943711 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49414 (local address 127.24.190.1:45995)
0928 20:15:18.944396 (+ 685us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:18.944398 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:18.944405 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:15:18.944434 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:18.944435 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:18.944443 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:18.944514 (+ 71us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:18.944612 (+ 98us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.945090 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.946013 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.946540 (+ 527us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.946630 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.946643 (+ 13us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:18.946784 (+ 141us) server_negotiation.cc:299] Negotiation successful
0928 20:15:18.946821 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":664,"thread_start_us":51,"threads_started":1}
I20260928 20:15:18.947404 32345 tablet_service.cc:1467] Processing CreateTablet for tablet 9827fe9c3be94fc68666091cc4af706a (DEFAULT_TABLE table=test-table [id=4cc6fee8bf6143a5a88263c289c20933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:18.947510 300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.943554 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:45169 (local address 127.0.0.1:50324)
0928 20:15:18.943803 (+ 249us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.943813 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:18.943871 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:18.944082 (+ 211us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:18.944082 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:18.944084 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:18.944280 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.944282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.945209 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.945210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.946497 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.946499 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.947268 (+ 769us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.947269 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.947335 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.947339 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:18.947391 (+ 52us) client_negotiation.cc:240] Negotiation successful
0928 20:15:18.947434 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":232,"mutex_wait_us":75,"thread_start_us":103,"threads_started":1}
I20260928 20:15:18.947504 313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.943640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50324 (local address 127.24.190.2:45169)
0928 20:15:18.943744 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:18.943746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:18.943859 (+ 113us) server_negotiation.cc:407] Connection header received
0928 20:15:18.943953 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:18.943954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:18.943964 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:18.944031 (+ 67us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:18.944349 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.945110 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.946598 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.947152 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.947223 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.947234 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:18.947396 (+ 162us) server_negotiation.cc:299] Negotiation successful
0928 20:15:18.947435 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80,"thread_start_us":55,"threads_started":1}
I20260928 20:15:18.947542 32345 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9827fe9c3be94fc68666091cc4af706a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:18.947592 315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.943740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54566 (local address 127.24.190.3:36439)
0928 20:15:18.943839 (+ 99us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:18.943841 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:18.943919 (+ 78us) server_negotiation.cc:407] Connection header received
0928 20:15:18.943953 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:18.943954 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:18.943965 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:18.944031 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:18.944349 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.945110 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.946598 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.947163 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.947226 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.947236 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:18.947468 (+ 232us) server_negotiation.cc:299] Negotiation successful
0928 20:15:18.947522 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76,"thread_start_us":50,"threads_started":1}
I20260928 20:15:18.947744 311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.943557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36439 (local address 127.0.0.1:54566)
0928 20:15:18.943856 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.943865 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:18.943909 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:18.944081 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:18.944082 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:18.944084 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:18.944280 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.944282 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.945209 (+ 927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.945210 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.946499 (+ 1289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.946500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.947240 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.947241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.947309 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.947315 (+ 6us) client_negotiation.cc:769] Sending connection context
0928 20:15:18.947363 (+ 48us) client_negotiation.cc:240] Negotiation successful
0928 20:15:18.947400 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":283,"mutex_wait_us":187,"thread_start_us":97,"threads_started":1}
I20260928 20:15:18.947763 32482 tablet_service.cc:1467] Processing CreateTablet for tablet 9827fe9c3be94fc68666091cc4af706a (DEFAULT_TABLE table=test-table [id=4cc6fee8bf6143a5a88263c289c20933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:18.947861 32482 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9827fe9c3be94fc68666091cc4af706a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:18.947983 32618 tablet_service.cc:1467] Processing CreateTablet for tablet 9827fe9c3be94fc68666091cc4af706a (DEFAULT_TABLE table=test-table [id=4cc6fee8bf6143a5a88263c289c20933]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:18.948081 32618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9827fe9c3be94fc68666091cc4af706a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:18.949146 316 tablet_bootstrap.cc:492] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: Bootstrap starting.
I20260928 20:15:18.949422 318 tablet_bootstrap.cc:492] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Bootstrap starting.
I20260928 20:15:18.949508 316 tablet_bootstrap.cc:654] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:18.949767 318 tablet_bootstrap.cc:654] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:18.950086 316 tablet_bootstrap.cc:492] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: No bootstrap required, opened a new log
I20260928 20:15:18.950104 317 tablet_bootstrap.cc:492] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Bootstrap starting.
I20260928 20:15:18.950157 316 ts_tablet_manager.cc:1397] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:18.950338 316 raft_consensus.cc:348] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.950438 316 raft_consensus.cc:374] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:18.950462 316 raft_consensus.cc:729] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 52fb0c67626c49aabe124cc62e74b233, State: Initialized, Role: FOLLOWER
I20260928 20:15:18.950486 317 tablet_bootstrap.cc:654] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:18.950515 316 consensus_queue.cc:260] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.950722 318 tablet_bootstrap.cc:492] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: No bootstrap required, opened a new log
I20260928 20:15:18.950824 318 ts_tablet_manager.cc:1397] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:18.950966 318 raft_consensus.cc:348] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.951031 318 raft_consensus.cc:374] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:18.951050 318 raft_consensus.cc:729] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2a77f7a2a5c41f49c36bdc616c7a46f, State: Initialized, Role: FOLLOWER
I20260928 20:15:18.951114 318 consensus_queue.cc:260] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.951345 318 ts_tablet_manager.cc:1428] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:18.951381 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.950858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:44315)
0928 20:15:18.950968 (+ 110us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.950996 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260928 20:15:18.951646 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.951537 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:33163)
0928 20:15:18.951575 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.951606 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":20}
I20260928 20:15:18.950695 316 ts_tablet_manager.cc:1428] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:18.951810 32684 heartbeater.cc:503] Master 127.24.190.60:33543 was elected leader, sending a full tablet report...
I20260928 20:15:18.951889 32411 heartbeater.cc:503] Master 127.24.190.60:33543 was elected leader, sending a full tablet report...
I20260928 20:15:18.952297 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.952102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:43183)
0928 20:15:18.952244 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.952270 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126}
I20260928 20:15:18.952718 317 tablet_bootstrap.cc:492] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: No bootstrap required, opened a new log
I20260928 20:15:18.952782 317 ts_tablet_manager.cc:1397] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260928 20:15:18.952941 317 raft_consensus.cc:348] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.952996 317 raft_consensus.cc:374] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:18.953008 317 raft_consensus.cc:729] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16bc12e7f85f43439f943cb25f1bbda7, State: Initialized, Role: FOLLOWER
I20260928 20:15:18.953075 317 consensus_queue.cc:260] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.953238 317 ts_tablet_manager.cc:1428] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:18.953555 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.953444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:59683)
0928 20:15:18.953501 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.953527 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 20:15:18.953701 32548 heartbeater.cc:503] Master 127.24.190.60:33543 was elected leader, sending a full tablet report...
I20260928 20:15:18.963837 321 raft_consensus.cc:482] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:18.963935 321 raft_consensus.cc:504] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.964273 321 leader_election.cc:288] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169), b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439)
I20260928 20:15:18.967067 325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.964431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36439 (local address 127.24.190.1:41987)
0928 20:15:18.964589 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.964599 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:18.964639 (+ 40us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:18.964839 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:18.964840 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:18.964843 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:18.964899 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.964901 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.965536 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.965536 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.966253 (+ 717us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.966255 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.966823 (+ 568us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.966824 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.966899 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.966904 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:18.966957 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:15:18.967004 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
I20260928 20:15:18.967087 315 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.964544 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:41987 (local address 127.24.190.3:36439)
0928 20:15:18.964622 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:18.964625 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:18.964634 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:18.964719 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:18.964720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:18.964730 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:18.964760 (+ 30us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:18.964967 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.965459 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.966401 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.966746 (+ 345us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.966797 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.966805 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:18.966972 (+ 167us) server_negotiation.cc:299] Negotiation successful
0928 20:15:18.967010 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260928 20:15:18.967271 313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.964501 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:55983 (local address 127.24.190.2:45169)
0928 20:15:18.964587 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:18.964589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:18.964598 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:18.964623 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:18.964623 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:18.964632 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:18.964687 (+ 55us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:18.964824 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.965358 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.966373 (+ 1015us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.966871 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.966944 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.966955 (+ 11us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:18.967139 (+ 184us) server_negotiation.cc:299] Negotiation successful
0928 20:15:18.967188 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260928 20:15:18.967231 32764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.964407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:45169 (local address 127.24.190.1:55983)
0928 20:15:18.964457 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.964469 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:18.964523 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:18.964700 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:18.964702 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:18.964705 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:18.964761 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.964762 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.965434 (+ 672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.965435 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.966237 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:18.966239 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.966996 (+ 757us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.966997 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:18.967054 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.967058 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:18.967117 (+ 59us) client_negotiation.cc:240] Negotiation successful
0928 20:15:18.967159 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":31}
I20260928 20:15:18.967492 32638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9827fe9c3be94fc68666091cc4af706a" candidate_uuid: "52fb0c67626c49aabe124cc62e74b233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" is_pre_election: true
I20260928 20:15:18.967640 32638 raft_consensus.cc:2454] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52fb0c67626c49aabe124cc62e74b233 in term 0.
I20260928 20:15:18.967639 32502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9827fe9c3be94fc68666091cc4af706a" candidate_uuid: "52fb0c67626c49aabe124cc62e74b233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16bc12e7f85f43439f943cb25f1bbda7" is_pre_election: true
I20260928 20:15:18.967739 32502 raft_consensus.cc:2454] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 52fb0c67626c49aabe124cc62e74b233 in term 0.
I20260928 20:15:18.967855 32301 leader_election.cc:302] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 52fb0c67626c49aabe124cc62e74b233, b2a77f7a2a5c41f49c36bdc616c7a46f; no voters:
I20260928 20:15:18.968032 321 raft_consensus.cc:2781] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:18.968098 321 raft_consensus.cc:482] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:18.968132 321 raft_consensus.cc:3037] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:18.968904 321 raft_consensus.cc:504] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.969064 321 leader_election.cc:288] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [CANDIDATE]: Term 1 election: Requested vote from peers 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169), b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439)
I20260928 20:15:18.969187 32502 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9827fe9c3be94fc68666091cc4af706a" candidate_uuid: "52fb0c67626c49aabe124cc62e74b233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16bc12e7f85f43439f943cb25f1bbda7"
I20260928 20:15:18.969225 32638 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9827fe9c3be94fc68666091cc4af706a" candidate_uuid: "52fb0c67626c49aabe124cc62e74b233" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f"
I20260928 20:15:18.969277 32502 raft_consensus.cc:3037] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:18.969295 32638 raft_consensus.cc:3037] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:18.970028 32502 raft_consensus.cc:2454] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52fb0c67626c49aabe124cc62e74b233 in term 1.
I20260928 20:15:18.970091 32638 raft_consensus.cc:2454] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 52fb0c67626c49aabe124cc62e74b233 in term 1.
I20260928 20:15:18.970218 32300 leader_election.cc:302] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16bc12e7f85f43439f943cb25f1bbda7, 52fb0c67626c49aabe124cc62e74b233; no voters:
I20260928 20:15:18.970329 321 raft_consensus.cc:2781] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:18.970481 321 raft_consensus.cc:686] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 1 LEADER]: Becoming Leader. State: Replica: 52fb0c67626c49aabe124cc62e74b233, State: Running, Role: LEADER
I20260928 20:15:18.970562 321 consensus_queue.cc:237] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } }
I20260928 20:15:18.970784 325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.970683 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:53931)
0928 20:15:18.970726 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.970759 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260928 20:15:18.971431 32232 catalog_manager.cc:5495] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 reported cstate change: term changed from 0 to 1, leader changed from <none> to 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1). New cstate: current_term: 1 leader_uuid: "52fb0c67626c49aabe124cc62e74b233" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "52fb0c67626c49aabe124cc62e74b233" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 45995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:18.984010 314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.981285 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49428 (local address 127.24.190.1:45995)
0928 20:15:18.981350 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:18.981352 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:18.981361 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:18.981459 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:18.981460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:18.981478 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:18.981538 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:18.981651 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.982150 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.983035 (+ 885us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:18.983368 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:18.983445 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:18.983631 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:18.983755 (+ 124us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:18.983840 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:18.983892 (+ 52us) server_negotiation.cc:299] Negotiation successful
0928 20:15:18.983917 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 20:15:18.985332 32502 raft_consensus.cc:1261] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Refusing update from remote peer 52fb0c67626c49aabe124cc62e74b233: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:18.985489 32638 raft_consensus.cc:1261] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Refusing update from remote peer 52fb0c67626c49aabe124cc62e74b233: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:18.985716 326 consensus_queue.cc:1035] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "16bc12e7f85f43439f943cb25f1bbda7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 45169 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:18.985841 321 consensus_queue.cc:1035] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2a77f7a2a5c41f49c36bdc616c7a46f" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36439 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:18.986650 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.986498 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:42383)
0928 20:15:18.986561 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.986612 (+ 51us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 20:15:18.987326 330 mvcc.cc:205] Tried to move back new op lower bound from 7334406221761265664 to 7334406221703770112. Current Snapshot: MvccSnapshot[applied={T|T < 7334406221761265664}]
I20260928 20:15:18.987787 325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.987677 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:58617)
0928 20:15:18.987718 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.987752 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":21}
I20260928 20:15:18.987984 32765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.987891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.2:59643)
0928 20:15:18.987928 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.987952 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260928 20:15:18.988147 325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.988057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.1:59815)
0928 20:15:18.988094 (+ 37us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.988119 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":24}
I20260928 20:15:18.988626 32766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:18.988442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:46561 (local address 127.24.190.3:51287)
0928 20:15:18.988558 (+ 116us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:18.988587 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:46561: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260928 20:15:18.991009 32227 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:18.991124 32227 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37102:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:18.992964 32227 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7280935e2a7f4542bf8a7fd1d9d48639: Sending DeleteTablet for 3 replicas of tablet 9827fe9c3be94fc68666091cc4af706a
I20260928 20:15:18.993292 32345 tablet_service.cc:1514] Processing DeleteTablet for tablet 9827fe9c3be94fc68666091cc4af706a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:18 UTC) from {username='oryx', principal='oryx/127.24.190.60@KRBTEST.COM'} at 127.0.0.1:49414
I20260928 20:15:18.993368 32482 tablet_service.cc:1514] Processing DeleteTablet for tablet 9827fe9c3be94fc68666091cc4af706a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:18 UTC) from {username='oryx', principal='oryx/127.24.190.60@KRBTEST.COM'} at 127.0.0.1:50324
I20260928 20:15:18.993496 341 tablet_replica.cc:330] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: stopping tablet replica
I20260928 20:15:18.993551 341 raft_consensus.cc:2229] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:18.993587 342 tablet_replica.cc:330] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: stopping tablet replica
I20260928 20:15:18.993633 342 raft_consensus.cc:2229] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:18.993646 341 raft_consensus.cc:2258] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:18.993670 342 raft_consensus.cc:2258] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:18.993986 342 ts_tablet_manager.cc:1905] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:18.994015 341 ts_tablet_manager.cc:1905] T 9827fe9c3be94fc68666091cc4af706a P 52fb0c67626c49aabe124cc62e74b233: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:18.994329 32618 tablet_service.cc:1514] Processing DeleteTablet for tablet 9827fe9c3be94fc68666091cc4af706a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:18 UTC) from {username='oryx', principal='oryx/127.24.190.60@KRBTEST.COM'} at 127.0.0.1:54566
I20260928 20:15:18.994915 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 32193
I20260928 20:15:18.995913 342 ts_tablet_manager.cc:1918] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:18.995954 342 log.cc:1196] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/9827fe9c3be94fc68666091cc4af706a
I20260928 20:15:18.996129 342 ts_tablet_manager.cc:1939] T 9827fe9c3be94fc68666091cc4af706a P 16bc12e7f85f43439f943cb25f1bbda7: Deleting consensus metadata
I20260928 20:15:18.996706 32218 catalog_manager.cc:4841] TS 16bc12e7f85f43439f943cb25f1bbda7 (127.24.190.2:45169): tablet 9827fe9c3be94fc68666091cc4af706a (table test-table [id=4cc6fee8bf6143a5a88263c289c20933]) successfully deleted
I20260928 20:15:18.998399 343 tablet_replica.cc:330] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: stopping tablet replica
I20260928 20:15:18.998456 343 raft_consensus.cc:2229] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:18.998512 343 raft_consensus.cc:2258] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:18.998761 343 ts_tablet_manager.cc:1905] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:19.000140 343 ts_tablet_manager.cc:1918] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:19.000190 343 log.cc:1196] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/9827fe9c3be94fc68666091cc4af706a
I20260928 20:15:19.000463 343 ts_tablet_manager.cc:1939] T 9827fe9c3be94fc68666091cc4af706a P b2a77f7a2a5c41f49c36bdc616c7a46f: Deleting consensus metadata
I20260928 20:15:19.000811 32219 catalog_manager.cc:4841] TS b2a77f7a2a5c41f49c36bdc616c7a46f (127.24.190.3:36439): tablet 9827fe9c3be94fc68666091cc4af706a (table test-table [id=4cc6fee8bf6143a5a88263c289c20933]) successfully deleted
I20260928 20:15:19.001680 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 32419
I20260928 20:15:19.001753 311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:19.001632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:45995 (local address 127.0.0.1:49432)
0928 20:15:19.001680 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:19.001717 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:45995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":23}
W20260928 20:15:19.001888 32216 catalog_manager.cc:4584] TS 52fb0c67626c49aabe124cc62e74b233 (127.24.190.1:45995): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 9827fe9c3be94fc68666091cc4af706a: Network error: Client connection negotiation failed: client connection to 127.24.190.1:45995: connect: Connection refused (error 111)
I20260928 20:15:19.007237 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 32555
I20260928 20:15:19.012894 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 31913
I20260928 20:15:19.017866 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 32100
2026-09-28T20:15:19Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (6497 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:19 dist-test-slave-n45k krb5kdc[346](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:19 dist-test-slave-n45k krb5kdc[346](info): set up 2 sockets
Sep 28 20:15:19 dist-test-slave-n45k krb5kdc[346](info): commencing operation
krb5kdc: starting...
W20260928 20:15:20.067302 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.027s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:20Z Disabled control of system clock
WARNING: no policy specified for oryx/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab.
Entry for principal oryx/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab.
I20260928 20:15:20.188666 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37943
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab
--principal=oryx/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:46429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:37943
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:20.270424 359 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:20.270649 359 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:20.270673 359 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:20.271875 359 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:20.271929 359 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260928 20:15:20.271943 359 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:20.271956 359 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:20.271968 359 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:20.271981 359 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:20.273569 359 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:37943
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.62.keytab
--principal=oryx/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37943
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.359
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:20.273833 359 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:20.274068 359 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:20.279116 365 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.279171 364 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:20.279239 359 server_base.cc:1034] running on GCE node
W20260928 20:15:20.279116 367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:20.279701 359 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:20.280009 359 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:20.281163 359 hybrid_clock.cc:648] HybridClock initialized: now 1790626520281144 us; error 42 us; skew 500 ppm
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:20.287775 359 init.cc:377] Logged in from keytab as oryx/127.24.190.62@KRBTEST.COM (short username oryx)
I20260928 20:15:20.288173 359 webserver.cc:460] Webserver started at http://127.24.190.62:44251/ using document root <none> and password file <none>
I20260928 20:15:20.288370 359 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:20.288412 359 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:20.288503 359 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:20.289507 359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "cfecf87ac5464143abbb102a01427d99"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "5238e4019f3e41b24fa7a2b69157bf8d"
server_key_iv: "7357814121895ff0bca6e74967ecc192"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.289803 359 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "cfecf87ac5464143abbb102a01427d99"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "5238e4019f3e41b24fa7a2b69157bf8d"
server_key_iv: "7357814121895ff0bca6e74967ecc192"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.291153 359 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:20.291911 374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.292091 359 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:20.292198 359 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "cfecf87ac5464143abbb102a01427d99"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "5238e4019f3e41b24fa7a2b69157bf8d"
server_key_iv: "7357814121895ff0bca6e74967ecc192"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.292305 359 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:20.319394 359 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:20.321519 359 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:20.321694 359 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:20.326640 359 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:37943
I20260928 20:15:20.326725 437 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:37943 every 8 connection(s)
I20260928 20:15:20.327101 359 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:20.327788 438 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:20.329967 438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Bootstrap starting.
I20260928 20:15:20.330628 438 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:20.330868 438 log.cc:824] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:20.331524 438 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: No bootstrap required, opened a new log
I20260928 20:15:20.333509 438 raft_consensus.cc:348] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfecf87ac5464143abbb102a01427d99" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37943 } }
I20260928 20:15:20.333662 438 raft_consensus.cc:374] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:20.333685 438 raft_consensus.cc:729] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfecf87ac5464143abbb102a01427d99, State: Initialized, Role: FOLLOWER
I20260928 20:15:20.333830 438 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfecf87ac5464143abbb102a01427d99" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37943 } }
I20260928 20:15:20.333913 438 raft_consensus.cc:388] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:20.333959 438 raft_consensus.cc:482] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:20.334010 438 raft_consensus.cc:3037] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:20.334033 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 359
I20260928 20:15:20.334198 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:20.334438 25336 external_mini_cluster.cc:1428] Setting key 7812ce2bb5146b98658d889cbb7d95a7
I20260928 20:15:20.334770 438 raft_consensus.cc:504] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfecf87ac5464143abbb102a01427d99" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37943 } }
I20260928 20:15:20.334890 438 leader_election.cc:302] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cfecf87ac5464143abbb102a01427d99; no voters:
I20260928 20:15:20.335151 438 leader_election.cc:288] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:20.335191 442 raft_consensus.cc:2781] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:20.335327 442 raft_consensus.cc:686] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [term 1 LEADER]: Becoming Leader. State: Replica: cfecf87ac5464143abbb102a01427d99, State: Running, Role: LEADER
I20260928 20:15:20.335431 438 sys_catalog.cc:564] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:20.335461 442 consensus_queue.cc:237] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfecf87ac5464143abbb102a01427d99" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37943 } }
I20260928 20:15:20.335876 444 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cfecf87ac5464143abbb102a01427d99. Latest consensus state: current_term: 1 leader_uuid: "cfecf87ac5464143abbb102a01427d99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfecf87ac5464143abbb102a01427d99" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37943 } } }
I20260928 20:15:20.336000 444 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:20.336205 445 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "cfecf87ac5464143abbb102a01427d99" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cfecf87ac5464143abbb102a01427d99" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37943 } } }
I20260928 20:15:20.336313 445 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:20.336609 452 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:20.337172 452 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:20.338846 452 catalog_manager.cc:1347] Generated new cluster ID: ab3c1db9f4944c2891821b054f16dbcc
I20260928 20:15:20.338898 452 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:20.346932 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.335038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43560 (local address 127.24.190.62:37943)
0928 20:15:20.335294 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.335304 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.335342 (+ 38us) server_negotiation.cc:407] Connection header received
0928 20:15:20.335463 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.335470 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.335527 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.335687 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.336550 (+ 863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.338083 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.339154 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.339768 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.339920 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.342878 (+ 2958us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.342884 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.342884 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.342900 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.345119 (+ 2219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.345552 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.345555 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.345556 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.345686 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.345918 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.345919 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.345919 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.346260 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.346443 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.346526 (+ 83us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.346678 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":155,"thread_start_us":90,"threads_started":1}
I20260928 20:15:20.348495 452 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:20.349211 452 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:20.358227 452 catalog_manager.cc:5868] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Generated new TSK 0
I20260928 20:15:20.358454 452 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab.
Entry for principal oryx/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab.
I20260928 20:15:20.389559 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37943
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:46429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:20.474184 464 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:20.474426 464 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:20.474452 464 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:20.475630 464 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:20.475666 464 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:20.475687 464 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:15:20.475704 464 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:20.477190 464 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:37943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.464
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:20.477381 464 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:20.477555 464 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:20.482824 472 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.482841 469 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.482914 470 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:20.482954 464 server_base.cc:1034] running on GCE node
I20260928 20:15:20.483266 464 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:20.483520 464 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:20.484674 464 hybrid_clock.cc:648] HybridClock initialized: now 1790626520484662 us; error 27 us; skew 500 ppm
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:20.487166 464 init.cc:377] Logged in from keytab as oryx/127.24.190.1@KRBTEST.COM (short username oryx)
I20260928 20:15:20.487584 464 webserver.cc:460] Webserver started at http://127.24.190.1:40559/ using document root <none> and password file <none>
I20260928 20:15:20.487814 464 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:20.487880 464 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:20.488039 464 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:20.489161 464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "2bacdee8bdd0790d8a693448c80346c1"
server_key_iv: "e6f34a464f1bc9b13ae444d9d047dbb0"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.489530 464 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "2bacdee8bdd0790d8a693448c80346c1"
server_key_iv: "e6f34a464f1bc9b13ae444d9d047dbb0"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.490923 464 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:20.491669 479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.491861 464 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:20.491961 464 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "2bacdee8bdd0790d8a693448c80346c1"
server_key_iv: "e6f34a464f1bc9b13ae444d9d047dbb0"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.492036 464 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:20.523517 464 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:20.525517 464 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:20.525689 464 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:20.526213 464 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:20.526278 464 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.526373 464 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:20.526405 464 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.533340 464 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:38177
I20260928 20:15:20.533408 594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:38177 every 8 connection(s)
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:20.533741 464 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:20.534746 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 464
I20260928 20:15:20.534888 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:20.535099 25336 external_mini_cluster.cc:1428] Setting key 0186f4c297fa5327a0431e62e2296ceb
I20260928 20:15:20.537566 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.526759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:49455 (local address 127.24.190.62:37943)
0928 20:15:20.526833 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.526835 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.527084 (+ 249us) server_negotiation.cc:407] Connection header received
0928 20:15:20.527700 (+ 616us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.527702 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.527721 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.527810 (+ 89us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.528623 (+ 813us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.529472 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.530743 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.531111 (+ 368us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.531227 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.534126 (+ 2899us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.534128 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.534128 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.534138 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.535935 (+ 1797us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.536477 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.536477 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.536478 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.536527 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.536812 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.536813 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.536813 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.536914 (+ 101us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.536961 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.537351 (+ 390us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.537446 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:15:20.537619 488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.526748 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.24.190.1:49455)
0928 20:15:20.526952 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.526991 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.527594 (+ 603us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.527874 (+ 280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.527878 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.528234 (+ 356us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:20.528515 (+ 281us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.528522 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.529571 (+ 1049us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.529573 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.530644 (+ 1071us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.530646 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.531241 (+ 595us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.531243 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.531413 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.532029 (+ 616us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:20.532038 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:20.533982 (+ 1944us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:20.536048 (+ 2066us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.536056 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.536058 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.536354 (+ 296us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.536592 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.536593 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.536594 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.536745 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.536978 (+ 233us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:20.536983 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:20.537184 (+ 201us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.537318 (+ 134us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.537465 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":150,"thread_start_us":107,"threads_started":1}
I20260928 20:15:20.538097 595 heartbeater.cc:347] Connected to a master server at 127.24.190.62:37943
I20260928 20:15:20.538211 595 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:20.538452 595 heartbeater.cc:511] Master 127.24.190.62:37943 requested a full tablet report, sending...
I20260928 20:15:20.539453 391 ts_manager.cc:194] Registered new tserver with Master: 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177)
I20260928 20:15:20.540494 391 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:49455
WARNING: no policy specified for oryx/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:15:20.545444 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.539399 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:54837 (local address 127.24.190.62:37943)
0928 20:15:20.539444 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.539446 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.539576 (+ 130us) server_negotiation.cc:407] Connection header received
0928 20:15:20.539649 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.539650 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.539659 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.539714 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.540038 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.540580 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.541557 (+ 977us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.541897 (+ 340us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.541976 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.542860 (+ 884us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.542861 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.542862 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.542869 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.544410 (+ 1541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.544725 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.544726 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.544726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.544799 (+ 73us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.544972 (+ 173us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.544972 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.544972 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.545064 (+ 92us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.545170 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.545318 (+ 148us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.545383 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:15:20.545560 602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.539340 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.24.190.1:54837)
0928 20:15:20.539497 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.539528 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.539599 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.539720 (+ 121us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.539720 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.539908 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:20.539960 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.539961 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.540700 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.540700 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.541471 (+ 771us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.541473 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.541981 (+ 508us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.541981 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.542032 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.542497 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:20.542501 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:20.542773 (+ 272us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:20.544500 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.544501 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.544501 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.544660 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.544858 (+ 198us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.544859 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.544859 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.544907 (+ 48us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.545129 (+ 222us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:20.545130 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:20.545214 (+ 84us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.545299 (+ 85us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.545428 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":72,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab.
Entry for principal oryx/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab.
I20260928 20:15:20.562114 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37943
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:46429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:20.643219 604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:20.643442 604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:20.643467 604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:20.644665 604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:20.644711 604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:20.644731 604 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:15:20.644748 604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:20.646314 604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:37943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.604
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:20.646557 604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:20.646832 604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:20.652365 612 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.652400 609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.652379 610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:20.652521 604 server_base.cc:1034] running on GCE node
I20260928 20:15:20.652787 604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:20.653012 604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:20.654181 604 hybrid_clock.cc:648] HybridClock initialized: now 1790626520654175 us; error 34 us; skew 500 ppm
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:20.656787 604 init.cc:377] Logged in from keytab as oryx/127.24.190.2@KRBTEST.COM (short username oryx)
I20260928 20:15:20.657208 604 webserver.cc:460] Webserver started at http://127.24.190.2:44681/ using document root <none> and password file <none>
I20260928 20:15:20.657440 604 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:20.657507 604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:20.657665 604 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:20.658819 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "b816f72e006244f4abd44295ebc8e3a4"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "876775954c4790e4054a608ab4749050"
server_key_iv: "f12d5eb267134618b30118120ca29710"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.659192 604 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "b816f72e006244f4abd44295ebc8e3a4"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "876775954c4790e4054a608ab4749050"
server_key_iv: "f12d5eb267134618b30118120ca29710"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.660532 604 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:20.661231 619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.661405 604 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:20.661504 604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "b816f72e006244f4abd44295ebc8e3a4"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "876775954c4790e4054a608ab4749050"
server_key_iv: "f12d5eb267134618b30118120ca29710"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.661586 604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:20.685925 604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:20.688422 604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:20.688599 604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:20.689142 604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:20.689208 604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.689250 604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:20.689275 604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.695837 604 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:43091
I20260928 20:15:20.695986 734 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:43091 every 8 connection(s)
I20260928 20:15:20.696319 604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:20.697415 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 604
I20260928 20:15:20.697543 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:20.697733 25336 external_mini_cluster.cc:1428] Setting key ad4d5fbf666dbace2f604aa09e5eba7a
I20260928 20:15:20.700227 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.689601 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:60501 (local address 127.24.190.62:37943)
0928 20:15:20.689647 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.689649 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.689888 (+ 239us) server_negotiation.cc:407] Connection header received
0928 20:15:20.690517 (+ 629us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.690518 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.690531 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.690585 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.691549 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.692396 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.693998 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.694379 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.694467 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.697217 (+ 2750us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.697218 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.697218 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.697225 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.698818 (+ 1593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.699239 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.699241 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.699241 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.699297 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.699581 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.699582 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.699582 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.699699 (+ 117us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.699774 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.700041 (+ 267us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.700131 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:15:20.700438 628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.689615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.24.190.2:60501)
0928 20:15:20.689772 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.689806 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.690406 (+ 600us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.690675 (+ 269us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.690678 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.691090 (+ 412us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:20.691409 (+ 319us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.691415 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.692505 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.692506 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.693902 (+ 1396us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.693905 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.694487 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.694488 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.694642 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.695274 (+ 632us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:20.695286 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:20.697131 (+ 1845us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:20.698918 (+ 1787us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.698924 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.698927 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.699150 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.699395 (+ 245us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.699396 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.699396 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.699507 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.699765 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:20.699771 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:20.699909 (+ 138us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.700020 (+ 111us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.700197 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":82,"threads_started":1}
I20260928 20:15:20.700975 735 heartbeater.cc:347] Connected to a master server at 127.24.190.62:37943
I20260928 20:15:20.701061 735 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:20.701251 735 heartbeater.cc:511] Master 127.24.190.62:37943 requested a full tablet report, sending...
I20260928 20:15:20.701627 390 ts_manager.cc:194] Registered new tserver with Master: b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091)
I20260928 20:15:20.702018 390 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:60501
WARNING: no policy specified for oryx/127.24.190.3@KRBTEST.COM; defaulting to no policy
I20260928 20:15:20.708643 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.702770 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:54735 (local address 127.24.190.62:37943)
0928 20:15:20.702813 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.702814 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.702968 (+ 154us) server_negotiation.cc:407] Connection header received
0928 20:15:20.703032 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.703033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.703040 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.703085 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.703471 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.703910 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.704966 (+ 1056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.705138 (+ 172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.705191 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.706176 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.706177 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.706177 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.706183 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.707651 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.707998 (+ 347us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.707999 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.707999 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.708060 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.708211 (+ 151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.708211 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.708211 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.708366 (+ 155us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.708418 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.708528 (+ 110us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.708583 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:15:20.708649 742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.702715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.24.190.2:54735)
0928 20:15:20.702898 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.702908 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.702974 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.703093 (+ 119us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.703094 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.703327 (+ 233us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:20.703396 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.703398 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.704009 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.704010 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.704877 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.704879 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.705212 (+ 333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.705213 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.705281 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.705700 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:20.705706 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:20.706088 (+ 382us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:20.707724 (+ 1636us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.707725 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.707725 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.707921 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.708122 (+ 201us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.708122 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.708122 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.708168 (+ 46us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.708423 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:20.708424 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:20.708460 (+ 36us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.708511 (+ 51us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.708585 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":158,"thread_start_us":133,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab.
Entry for principal oryx/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab.
I20260928 20:15:20.725219 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37943
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:46429
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:20.820978 744 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:20.821182 744 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:20.821208 744 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:20.822328 744 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:20.822364 744 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:20.822384 744 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260928 20:15:20.822402 744 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:20.823920 744 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46429
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.24.190.62:37943
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.744
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:20.824110 744 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:20.824347 744 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:20.829392 750 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.829406 749 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:20.829406 752 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:20.829484 744 server_base.cc:1034] running on GCE node
I20260928 20:15:20.829800 744 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:20.830082 744 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:20.831342 744 hybrid_clock.cc:648] HybridClock initialized: now 1790626520831301 us; error 50 us; skew 500 ppm
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:20.833818 744 init.cc:377] Logged in from keytab as oryx/127.24.190.3@KRBTEST.COM (short username oryx)
I20260928 20:15:20.834342 744 webserver.cc:460] Webserver started at http://127.24.190.3:42383/ using document root <none> and password file <none>
I20260928 20:15:20.834585 744 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:20.834654 744 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:20.834807 744 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:20.835997 744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "2423932b7d73c4afd6d42914920bf3e4"
server_key_iv: "a0f2fe6e44a9e968f012fec5307f0259"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.836452 744 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "2423932b7d73c4afd6d42914920bf3e4"
server_key_iv: "a0f2fe6e44a9e968f012fec5307f0259"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.837913 744 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:20.838809 759 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.839044 744 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:20.839147 744 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
format_stamp: "Formatted at 2026-09-28 20:15:20 on dist-test-slave-n45k"
server_key: "2423932b7d73c4afd6d42914920bf3e4"
server_key_iv: "a0f2fe6e44a9e968f012fec5307f0259"
server_key_version: "encryptionkey@0"
I20260928 20:15:20.839236 744 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:20.851663 744 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:20.853866 744 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:20.854065 744 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:20.854719 744 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:20.854789 744 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.854837 744 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:20.854868 744 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:20.862249 744 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:38943
I20260928 20:15:20.862366 874 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:38943 every 8 connection(s)
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:20.862675 744 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:20.865957 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.855195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:44843 (local address 127.24.190.62:37943)
0928 20:15:20.855296 (+ 101us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.855299 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.855465 (+ 166us) server_negotiation.cc:407] Connection header received
0928 20:15:20.856006 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.856008 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.856020 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.856077 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.856954 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.857791 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.859788 (+ 1997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.860116 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.860186 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.863196 (+ 3010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.863197 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.863198 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.863204 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.864612 (+ 1408us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.865015 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.865016 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.865016 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.865069 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.865356 (+ 287us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.865357 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.865357 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.865460 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.865511 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.865761 (+ 250us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.865823 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260928 20:15:20.866000 768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.855181 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.24.190.3:44843)
0928 20:15:20.855347 (+ 166us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.855382 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.855897 (+ 515us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.856172 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.856178 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.856542 (+ 364us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:20.856863 (+ 321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.856871 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.857904 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.857905 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.859685 (+ 1780us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.859689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.860223 (+ 534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.860224 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.860395 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.861111 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:20.861123 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:20.863081 (+ 1958us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:20.864701 (+ 1620us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.864707 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.864709 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.864941 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.865171 (+ 230us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.865172 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.865173 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.865287 (+ 114us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.865519 (+ 232us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:20.865524 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:20.865634 (+ 110us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.865718 (+ 84us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.865843 (+ 125us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":82,"threads_started":1}
I20260928 20:15:20.866566 875 heartbeater.cc:347] Connected to a master server at 127.24.190.62:37943
I20260928 20:15:20.866650 875 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:20.866848 875 heartbeater.cc:511] Master 127.24.190.62:37943 requested a full tablet report, sending...
I20260928 20:15:20.867256 391 ts_manager.cc:194] Registered new tserver with Master: 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:20.867636 391 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:44843
I20260928 20:15:20.870975 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 744
I20260928 20:15:20.871071 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:20.871254 25336 external_mini_cluster.cc:1428] Setting key 0e09b9015759ee85fcfe033eb821d9ce
I20260928 20:15:20.872083 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:15:20.873243 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.867700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:54761 (local address 127.24.190.62:37943)
0928 20:15:20.867763 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.867765 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.867841 (+ 76us) server_negotiation.cc:407] Connection header received
0928 20:15:20.867910 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.867911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.867920 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.867974 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.868284 (+ 310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.868747 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.869457 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.869660 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.869757 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.870636 (+ 879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.870637 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.870638 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.870644 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.872145 (+ 1501us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.872512 (+ 367us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.872513 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.872513 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.872570 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.872791 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.872791 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.872791 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.872891 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.872940 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.873092 (+ 152us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.873166 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 20:15:20.873332 881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.867642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.24.190.3:54761)
0928 20:15:20.867790 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.867800 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.867855 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.867979 (+ 124us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.867980 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.868150 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:20.868199 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.868200 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.868837 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.868838 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.869359 (+ 521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.869360 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.869760 (+ 400us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.869761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.869824 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.870183 (+ 359us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:20.870187 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:20.870543 (+ 356us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:20.872233 (+ 1690us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.872234 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.872234 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.872423 (+ 189us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.872657 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:20.872658 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:20.872658 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:20.872725 (+ 67us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:20.872953 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:20.872953 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:20.873000 (+ 47us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.873076 (+ 76us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.873190 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":61,"threads_started":1}
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 20:15:20.892850 443 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:20.887549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43570 (local address 127.24.190.62:37943)
0928 20:15:20.887601 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.887604 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.887616 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:15:20.887646 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.887647 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.887659 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.887729 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.888294 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.888771 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.889528 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.889712 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.889783 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.892763 (+ 2980us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43570: BlockingRecv error: recv got EOF from 127.0.0.1:43570 (error 108)
Metrics: {"server-negotiator.queue_time_us":27}
Sep 28 20:15:20 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:20.900709 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.893560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43572 (local address 127.24.190.62:37943)
0928 20:15:20.893613 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.893614 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.893624 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:20.893688 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.893689 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.893696 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.893751 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:20.894192 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.894830 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.895725 (+ 895us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.895945 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.895995 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.898373 (+ 2378us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:20.898375 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:20.898375 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:20.898381 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:20.899740 (+ 1359us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.900052 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.900053 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.900053 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.900113 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:20.900290 (+ 177us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:20.900291 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:20.900291 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:20.900394 (+ 103us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:20.900468 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.900582 (+ 114us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.900646 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 20:15:20.902606 391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:20.904214 391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:20.910396 898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.906459 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:38177 (local address 127.0.0.1:50222)
0928 20:15:20.906661 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.906753 (+ 92us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.906822 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.907164 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.907169 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.907172 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:20.907245 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.907247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.908576 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.908578 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.909364 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.909366 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.910103 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.910104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.910160 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.910171 (+ 11us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.910222 (+ 51us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.910261 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":170,"mutex_wait_us":6,"thread_start_us":89,"threads_started":1}
I20260928 20:15:20.910450 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.906575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50222 (local address 127.24.190.1:38177)
0928 20:15:20.906977 (+ 402us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.906982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.906992 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:20.907034 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.907036 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.907051 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.907146 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:20.907339 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.908471 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.909445 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.910026 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.910096 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.910162 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.910244 (+ 82us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.910346 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":365,"thread_start_us":82,"threads_started":1}
I20260928 20:15:20.911362 900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.906620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49044 (local address 127.24.190.3:38943)
0928 20:15:20.907040 (+ 420us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.907044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.907061 (+ 17us) server_negotiation.cc:407] Connection header received
0928 20:15:20.907107 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.907108 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.907145 (+ 37us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.907254 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:20.907406 (+ 152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.908501 (+ 1095us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.910375 (+ 1874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.911048 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.911107 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.911155 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.911272 (+ 117us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.911297 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":387,"thread_start_us":76,"threads_started":1}
I20260928 20:15:20.911381 897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.906503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38943 (local address 127.0.0.1:49044)
0928 20:15:20.906745 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.906754 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.906822 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.907260 (+ 438us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.907261 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.907263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:20.907321 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.907323 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.908577 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.908577 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.909697 (+ 1120us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.909698 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.911126 (+ 1428us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.911127 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.911192 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.911196 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.911264 (+ 68us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.911317 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"mutex_wait_us":27,"thread_start_us":81,"threads_started":1}
I20260928 20:15:20.911264 529 tablet_service.cc:1467] Processing CreateTablet for tablet ce635a5d1666451f87643488f64609ab (DEFAULT_TABLE table=test-table [id=de8adead43cb4cf6a853baa540e86ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:20.911610 529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce635a5d1666451f87643488f64609ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:20.912104 809 tablet_service.cc:1467] Processing CreateTablet for tablet ce635a5d1666451f87643488f64609ab (DEFAULT_TABLE table=test-table [id=de8adead43cb4cf6a853baa540e86ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:20.912369 809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce635a5d1666451f87643488f64609ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:20.914745 903 tablet_bootstrap.cc:492] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Bootstrap starting.
I20260928 20:15:20.915187 901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.906687 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43091 (local address 127.0.0.1:58874)
0928 20:15:20.906859 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.906871 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.906925 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.907451 (+ 526us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.907451 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.907453 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:20.907512 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.907514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.908363 (+ 849us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.908364 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.909670 (+ 1306us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.909673 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.914938 (+ 5265us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.914939 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.915006 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.915012 (+ 6us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.915074 (+ 62us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.915115 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":60,"threads_started":1}
I20260928 20:15:20.915216 902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.906891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58874 (local address 127.24.190.2:43091)
0928 20:15:20.907058 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.907062 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.907072 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:20.907108 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.907110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.907125 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.907566 (+ 441us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:20.907615 (+ 49us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.908273 (+ 658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.909766 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.910723 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.914930 (+ 4207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.915015 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.915087 (+ 72us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.915127 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":134,"thread_start_us":76,"threads_started":1}
I20260928 20:15:20.915423 903 tablet_bootstrap.cc:654] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:20.915591 904 tablet_bootstrap.cc:492] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Bootstrap starting.
I20260928 20:15:20.915751 903 log.cc:824] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:20.915998 669 tablet_service.cc:1467] Processing CreateTablet for tablet ce635a5d1666451f87643488f64609ab (DEFAULT_TABLE table=test-table [id=de8adead43cb4cf6a853baa540e86ab2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:20.916172 904 tablet_bootstrap.cc:654] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:20.916316 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ce635a5d1666451f87643488f64609ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:20.916472 904 log.cc:824] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:20.916555 903 tablet_bootstrap.cc:492] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: No bootstrap required, opened a new log
I20260928 20:15:20.916610 903 ts_tablet_manager.cc:1397] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:20.918211 903 raft_consensus.cc:348] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.918417 903 raft_consensus.cc:374] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:20.918462 903 raft_consensus.cc:729] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Initialized, Role: FOLLOWER
I20260928 20:15:20.918571 903 consensus_queue.cc:260] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.918855 903 ts_tablet_manager.cc:1428] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:15:20.918893 595 heartbeater.cc:503] Master 127.24.190.62:37943 was elected leader, sending a full tablet report...
I20260928 20:15:20.919468 904 tablet_bootstrap.cc:492] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: No bootstrap required, opened a new log
I20260928 20:15:20.919471 908 tablet_bootstrap.cc:492] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Bootstrap starting.
I20260928 20:15:20.919540 904 ts_tablet_manager.cc:1397] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.000s
I20260928 20:15:20.920035 908 tablet_bootstrap.cc:654] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:20.920369 908 log.cc:824] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:20.921063 908 tablet_bootstrap.cc:492] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: No bootstrap required, opened a new log
I20260928 20:15:20.921131 908 ts_tablet_manager.cc:1397] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:20.921840 904 raft_consensus.cc:348] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.922000 904 raft_consensus.cc:374] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:20.922035 904 raft_consensus.cc:729] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54af42b4f8d74a6580f4fee5de2f0fb0, State: Initialized, Role: FOLLOWER
I20260928 20:15:20.922147 904 consensus_queue.cc:260] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.922425 904 ts_tablet_manager.cc:1428] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:15:20.922461 875 heartbeater.cc:503] Master 127.24.190.62:37943 was elected leader, sending a full tablet report...
I20260928 20:15:20.923028 908 raft_consensus.cc:348] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.923137 908 raft_consensus.cc:374] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:20.923157 908 raft_consensus.cc:729] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Initialized, Role: FOLLOWER
I20260928 20:15:20.923285 908 consensus_queue.cc:260] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.923563 908 ts_tablet_manager.cc:1428] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:15:20.923579 735 heartbeater.cc:503] Master 127.24.190.62:37943 was elected leader, sending a full tablet report...
W20260928 20:15:20.946928 736 tablet.cc:2369] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:20.990870 911 raft_consensus.cc:482] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:20.991005 911 raft_consensus.cc:504] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.991375 911 leader_election.cc:288] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:20.994560 899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.991635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:57377 (local address 127.24.190.1:38177)
0928 20:15:20.991679 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.991681 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.991692 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:15:20.991803 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.991805 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.991816 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.991893 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:20.992059 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.992654 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.993721 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.994108 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.994202 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.994211 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.994435 (+ 224us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.994492 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:15:20.994560 628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.991572 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:38177 (local address 127.24.190.2:57377)
0928 20:15:20.991635 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.991646 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.991692 (+ 46us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.991910 (+ 218us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.991911 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.991912 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:20.991984 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.991986 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.992746 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.992747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.993620 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.993623 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.994201 (+ 578us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.994201 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.994341 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.994347 (+ 6us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.994425 (+ 78us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.994483 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":22}
I20260928 20:15:20.994643 900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.991773 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:51309 (local address 127.24.190.3:38943)
0928 20:15:20.991826 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:20.991828 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:20.991916 (+ 88us) server_negotiation.cc:407] Connection header received
0928 20:15:20.991986 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:20.991988 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:20.991997 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:20.992074 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:20.992231 (+ 157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.992776 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.993851 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.994238 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.994377 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.994386 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:20.994525 (+ 139us) server_negotiation.cc:299] Negotiation successful
0928 20:15:20.994560 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":33}
I20260928 20:15:20.994710 912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:20.991583 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38943 (local address 127.24.190.2:51309)
0928 20:15:20.991834 (+ 251us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:20.991843 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:20.991932 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:20.992076 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:20.992077 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:20.992079 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:20.992153 (+ 74us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.992154 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.992860 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.992861 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.993766 (+ 905us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:20.993769 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:20.994379 (+ 610us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:20.994380 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:20.994453 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:20.994457 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:20.994517 (+ 60us) client_negotiation.cc:240] Negotiation successful
0928 20:15:20.994558 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":202,"mutex_wait_us":13,"thread_start_us":128,"threads_started":1}
I20260928 20:15:20.994971 549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce635a5d1666451f87643488f64609ab" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" is_pre_election: true
I20260928 20:15:20.995133 549 raft_consensus.cc:2454] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 0.
I20260928 20:15:20.995291 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce635a5d1666451f87643488f64609ab" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" is_pre_election: true
I20260928 20:15:20.995375 620 leader_election.cc:302] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, b816f72e006244f4abd44295ebc8e3a4; no voters:
I20260928 20:15:20.995477 829 raft_consensus.cc:2454] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 0.
I20260928 20:15:20.995503 911 raft_consensus.cc:2781] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:20.995556 911 raft_consensus.cc:482] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:20.995594 911 raft_consensus.cc:3037] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:20.996596 911 raft_consensus.cc:504] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.996793 911 leader_election.cc:288] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 election: Requested vote from peers 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:20.996946 549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce635a5d1666451f87643488f64609ab" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11"
I20260928 20:15:20.996980 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ce635a5d1666451f87643488f64609ab" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
I20260928 20:15:20.997025 549 raft_consensus.cc:3037] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:20.997069 829 raft_consensus.cc:3037] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:20.997780 549 raft_consensus.cc:2454] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 1.
I20260928 20:15:20.997786 829 raft_consensus.cc:2454] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 1.
I20260928 20:15:20.997943 620 leader_election.cc:302] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, b816f72e006244f4abd44295ebc8e3a4; no voters:
I20260928 20:15:20.998054 911 raft_consensus.cc:2781] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:20.998211 911 raft_consensus.cc:686] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 1 LEADER]: Becoming Leader. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Running, Role: LEADER
I20260928 20:15:20.998340 911 consensus_queue.cc:237] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:20.999185 391 catalog_manager.cc:5495] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "b816f72e006244f4abd44295ebc8e3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:21.005177 902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.002834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58886 (local address 127.24.190.2:43091)
0928 20:15:21.002882 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.002884 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.002894 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:21.002951 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.002952 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.002976 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.003046 (+ 70us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:21.003181 (+ 135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.003649 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.004414 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.004607 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.004690 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.004880 (+ 190us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.004970 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.005060 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.005079 (+ 19us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.005098 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 20:15:21.007119 829 raft_consensus.cc:1261] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Refusing update from remote peer b816f72e006244f4abd44295ebc8e3a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.007122 549 raft_consensus.cc:1261] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Refusing update from remote peer b816f72e006244f4abd44295ebc8e3a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.007486 911 consensus_queue.cc:1035] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.007670 913 consensus_queue.cc:1035] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.009821 916 mvcc.cc:205] Tried to move back new op lower bound from 7334406230041505792 to 7334406230009815040. Current Snapshot: MvccSnapshot[applied={T|T < 7334406230041505792}]
I20260928 20:15:21.009960 917 mvcc.cc:205] Tried to move back new op lower bound from 7334406230041505792 to 7334406230009815040. Current Snapshot: MvccSnapshot[applied={T|T < 7334406230041505792}]
I20260928 20:15:21.010031 918 mvcc.cc:205] Tried to move back new op lower bound from 7334406230041505792 to 7334406230009815040. Current Snapshot: MvccSnapshot[applied={T|T < 7334406230041505792}]
I20260928 20:15:21.012157 391 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.012252 391 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.013038 391 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Sending DeleteTablet for 3 replicas of tablet ce635a5d1666451f87643488f64609ab
I20260928 20:15:21.013375 669 tablet_service.cc:1514] Processing DeleteTablet for tablet ce635a5d1666451f87643488f64609ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:58874
I20260928 20:15:21.013396 529 tablet_service.cc:1514] Processing DeleteTablet for tablet ce635a5d1666451f87643488f64609ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50222
I20260928 20:15:21.013406 809 tablet_service.cc:1514] Processing DeleteTablet for tablet ce635a5d1666451f87643488f64609ab with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:49044
I20260928 20:15:21.013589 927 tablet_replica.cc:330] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: stopping tablet replica
I20260928 20:15:21.013674 927 raft_consensus.cc:2229] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.013756 927 raft_consensus.cc:2258] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.013846 928 tablet_replica.cc:330] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: stopping tablet replica
I20260928 20:15:21.013859 391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43572:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260928 20:15:21.013939 928 raft_consensus.cc:2229] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:15:21.013998 391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:21.014354 928 raft_consensus.cc:2258] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.014533 927 ts_tablet_manager.cc:1905] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.015398 809 tablet_service.cc:1467] Processing CreateTablet for tablet 9fca7e14616741b0a7a34509876f752b (DEFAULT_TABLE table=test-table [id=fb02a7b959e04be99db183774909227c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.015452 669 tablet_service.cc:1467] Processing CreateTablet for tablet 9fca7e14616741b0a7a34509876f752b (DEFAULT_TABLE table=test-table [id=fb02a7b959e04be99db183774909227c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.015520 809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fca7e14616741b0a7a34509876f752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.015558 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fca7e14616741b0a7a34509876f752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.016579 926 tablet_replica.cc:330] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: stopping tablet replica
I20260928 20:15:21.016659 926 raft_consensus.cc:2229] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:21.016739 926 raft_consensus.cc:2258] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.016853 904 tablet_bootstrap.cc:492] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Bootstrap starting.
I20260928 20:15:21.016893 908 tablet_bootstrap.cc:492] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Bootstrap starting.
I20260928 20:15:21.017081 529 tablet_service.cc:1467] Processing CreateTablet for tablet 9fca7e14616741b0a7a34509876f752b (DEFAULT_TABLE table=test-table [id=fb02a7b959e04be99db183774909227c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.017272 904 tablet_bootstrap.cc:654] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.017315 908 tablet_bootstrap.cc:654] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.017884 926 ts_tablet_manager.cc:1905] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.018067 904 tablet_bootstrap.cc:492] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: No bootstrap required, opened a new log
I20260928 20:15:21.018121 904 ts_tablet_manager.cc:1397] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:21.018254 904 raft_consensus.cc:348] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.018350 904 raft_consensus.cc:374] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.018378 904 raft_consensus.cc:729] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54af42b4f8d74a6580f4fee5de2f0fb0, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.018419 904 consensus_queue.cc:260] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.018504 904 ts_tablet_manager.cc:1428] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent starting tablet: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:21.018774 908 tablet_bootstrap.cc:492] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: No bootstrap required, opened a new log
I20260928 20:15:21.018821 908 ts_tablet_manager.cc:1397] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:21.018950 908 raft_consensus.cc:348] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.019016 908 raft_consensus.cc:374] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.019035 908 raft_consensus.cc:729] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.019074 908 consensus_queue.cc:260] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.019147 908 ts_tablet_manager.cc:1428] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.019199 529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9fca7e14616741b0a7a34509876f752b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.019460 926 ts_tablet_manager.cc:1918] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:21.019531 926 log.cc:1196] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/ce635a5d1666451f87643488f64609ab
I20260928 20:15:21.019761 926 ts_tablet_manager.cc:1939] T ce635a5d1666451f87643488f64609ab P b816f72e006244f4abd44295ebc8e3a4: Deleting consensus metadata
I20260928 20:15:21.020468 903 tablet_bootstrap.cc:492] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Bootstrap starting.
I20260928 20:15:21.020488 375 catalog_manager.cc:4841] TS b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091): tablet ce635a5d1666451f87643488f64609ab (table test-table [id=de8adead43cb4cf6a853baa540e86ab2]) successfully deleted
I20260928 20:15:21.020903 927 ts_tablet_manager.cc:1918] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:21.020913 903 tablet_bootstrap.cc:654] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.021092 927 log.cc:1196] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/ce635a5d1666451f87643488f64609ab
I20260928 20:15:21.021369 927 ts_tablet_manager.cc:1939] T ce635a5d1666451f87643488f64609ab P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting consensus metadata
I20260928 20:15:21.021618 903 tablet_bootstrap.cc:492] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: No bootstrap required, opened a new log
I20260928 20:15:21.021679 903 ts_tablet_manager.cc:1397] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:21.021752 375 catalog_manager.cc:4841] TS 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177): tablet ce635a5d1666451f87643488f64609ab (table test-table [id=de8adead43cb4cf6a853baa540e86ab2]) successfully deleted
I20260928 20:15:21.021843 903 raft_consensus.cc:348] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.021932 903 raft_consensus.cc:374] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.021960 903 raft_consensus.cc:729] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.022010 903 consensus_queue.cc:260] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.022045 928 ts_tablet_manager.cc:1905] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.022090 903 ts_tablet_manager.cc:1428] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:21.023562 928 ts_tablet_manager.cc:1918] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:21.023634 928 log.cc:1196] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/ce635a5d1666451f87643488f64609ab
I20260928 20:15:21.023895 928 ts_tablet_manager.cc:1939] T ce635a5d1666451f87643488f64609ab P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting consensus metadata
I20260928 20:15:21.024289 376 catalog_manager.cc:4841] TS 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943): tablet ce635a5d1666451f87643488f64609ab (table test-table [id=de8adead43cb4cf6a853baa540e86ab2]) successfully deleted
W20260928 20:15:21.034525 596 tablet.cc:2369] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:15:21.113345 876 tablet.cc:2369] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:21.242264 907 raft_consensus.cc:482] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:21.242456 907 raft_consensus.cc:504] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.242851 907 leader_election.cc:288] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.245882 902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.243128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:36043 (local address 127.24.190.2:43091)
0928 20:15:21.243176 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.243178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.243297 (+ 119us) server_negotiation.cc:407] Connection header received
0928 20:15:21.243368 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.243369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.243384 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.243456 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:21.243597 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.244091 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.245129 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.245484 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.245567 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.245576 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.245749 (+ 173us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.245810 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:15:21.245904 932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.243043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:43091 (local address 127.24.190.1:36043)
0928 20:15:21.243243 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:21.243252 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:21.243301 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:21.243465 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:21.243466 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:21.243469 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:21.243538 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.243540 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.244179 (+ 639us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.244180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.245033 (+ 853us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.245035 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.245577 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.245579 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.245662 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.245665 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:21.245742 (+ 77us) client_negotiation.cc:240] Negotiation successful
0928 20:15:21.245788 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":155,"mutex_wait_us":3,"spinlock_wait_cycles":896,"thread_start_us":63,"threads_started":1}
I20260928 20:15:21.245882 900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.243213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:60493 (local address 127.24.190.3:38943)
0928 20:15:21.243259 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.243260 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.243272 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:15:21.243387 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.243390 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.243400 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.243432 (+ 32us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:21.243628 (+ 196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.244092 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.245131 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.245493 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.245586 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.245595 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.245771 (+ 176us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.245808 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 20:15:21.245929 933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.243043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38943 (local address 127.24.190.1:60493)
0928 20:15:21.243216 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:21.243228 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:21.243288 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:21.243503 (+ 215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:21.243503 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:21.243505 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:21.243560 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.243561 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.244186 (+ 625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.244187 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.245031 (+ 844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.245034 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.245588 (+ 554us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.245589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.245667 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.245670 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:21.245762 (+ 92us) client_negotiation.cc:240] Negotiation successful
0928 20:15:21.245813 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":157,"mutex_wait_us":112,"thread_start_us":57,"threads_started":1}
I20260928 20:15:21.246153 689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fca7e14616741b0a7a34509876f752b" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b816f72e006244f4abd44295ebc8e3a4" is_pre_election: true
I20260928 20:15:21.246289 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fca7e14616741b0a7a34509876f752b" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" is_pre_election: true
I20260928 20:15:21.246368 689 raft_consensus.cc:2454] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 0.
I20260928 20:15:21.246379 829 raft_consensus.cc:2454] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 0.
I20260928 20:15:21.246559 480 leader_election.cc:302] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, b816f72e006244f4abd44295ebc8e3a4; no voters:
I20260928 20:15:21.246699 907 raft_consensus.cc:2781] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:21.246745 907 raft_consensus.cc:482] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:21.246760 907 raft_consensus.cc:3037] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.247484 907 raft_consensus.cc:504] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.247628 907 leader_election.cc:288] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 election: Requested vote from peers b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.247787 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fca7e14616741b0a7a34509876f752b" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
I20260928 20:15:21.247789 689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fca7e14616741b0a7a34509876f752b" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b816f72e006244f4abd44295ebc8e3a4"
I20260928 20:15:21.247860 829 raft_consensus.cc:3037] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.247860 689 raft_consensus.cc:3037] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.248574 829 raft_consensus.cc:2454] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 1.
I20260928 20:15:21.248682 689 raft_consensus.cc:2454] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 1.
I20260928 20:15:21.248769 481 leader_election.cc:302] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, 54af42b4f8d74a6580f4fee5de2f0fb0; no voters:
I20260928 20:15:21.248893 907 raft_consensus.cc:2781] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:21.249007 907 raft_consensus.cc:686] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 LEADER]: Becoming Leader. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Running, Role: LEADER
I20260928 20:15:21.249064 907 consensus_queue.cc:237] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.249744 391 catalog_manager.cc:5495] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1). New cstate: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } health_report { overall_health: UNKNOWN } } }
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626520, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.62@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:21.330539 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.323032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37943 (local address 127.0.0.1:43576)
0928 20:15:21.323227 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:21.323237 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:21.323291 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:21.323441 (+ 150us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:21.323442 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:21.323740 (+ 298us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:21.323798 (+ 58us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.323817 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.324468 (+ 651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.324469 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.325020 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.325022 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.325384 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.325385 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.325425 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.326035 (+ 610us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:21.326040 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:21.327548 (+ 1508us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:21.329309 (+ 1761us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:21.329318 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:21.329320 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:21.329523 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:21.329747 (+ 224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:21.329748 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:21.329748 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:21.329813 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:21.330075 (+ 262us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:21.330083 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:21.330130 (+ 47us) client_negotiation.cc:769] Sending connection context
0928 20:15:21.330219 (+ 89us) client_negotiation.cc:240] Negotiation successful
0928 20:15:21.330402 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":81,"threads_started":1}
I20260928 20:15:21.330545 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.323127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43576 (local address 127.24.190.62:37943)
0928 20:15:21.323201 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.323204 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.323282 (+ 78us) server_negotiation.cc:407] Connection header received
0928 20:15:21.323342 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.323343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.323352 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.323428 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:21.323896 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.324394 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.325123 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.325311 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.325373 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.327649 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:21.327651 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:21.327651 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:21.327659 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:21.329214 (+ 1555us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:21.329610 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:21.329611 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:21.329611 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:21.329667 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:21.329877 (+ 210us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:21.329878 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:21.329879 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:21.330006 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:21.330085 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.330250 (+ 165us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.330460 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":104,"server-negotiator.queue_time_us":48}
I20260928 20:15:21.333027 391 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:43576:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260928 20:15:21.333263 391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:21.334885 529 tablet_service.cc:1467] Processing CreateTablet for tablet ad7ef39ef03d4f17a08aa773ac570162 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=961a9562a05f44c58a3c8c2f870bd48d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:15:21.334903 669 tablet_service.cc:1467] Processing CreateTablet for tablet ad7ef39ef03d4f17a08aa773ac570162 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=961a9562a05f44c58a3c8c2f870bd48d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:15:21.334928 809 tablet_service.cc:1467] Processing CreateTablet for tablet ad7ef39ef03d4f17a08aa773ac570162 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=961a9562a05f44c58a3c8c2f870bd48d]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260928 20:15:21.335060 809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad7ef39ef03d4f17a08aa773ac570162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.335063 529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad7ef39ef03d4f17a08aa773ac570162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.335064 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ad7ef39ef03d4f17a08aa773ac570162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.336632 903 tablet_bootstrap.cc:492] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Bootstrap starting.
I20260928 20:15:21.336635 904 tablet_bootstrap.cc:492] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: Bootstrap starting.
I20260928 20:15:21.337028 903 tablet_bootstrap.cc:654] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.337085 904 tablet_bootstrap.cc:654] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.337477 908 tablet_bootstrap.cc:492] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: Bootstrap starting.
I20260928 20:15:21.337773 903 tablet_bootstrap.cc:492] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: No bootstrap required, opened a new log
I20260928 20:15:21.337819 908 tablet_bootstrap.cc:654] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.337850 903 ts_tablet_manager.cc:1397] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:21.338002 903 raft_consensus.cc:348] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.338083 903 raft_consensus.cc:374] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.338114 903 raft_consensus.cc:729] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.338157 903 consensus_queue.cc:260] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.338251 903 ts_tablet_manager.cc:1428] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:21.338263 904 tablet_bootstrap.cc:492] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: No bootstrap required, opened a new log
I20260928 20:15:21.338330 904 ts_tablet_manager.cc:1397] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:15:21.338421 907 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.338500 907 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.338474 904 raft_consensus.cc:348] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.338548 904 raft_consensus.cc:374] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.338568 904 raft_consensus.cc:729] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54af42b4f8d74a6580f4fee5de2f0fb0, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.338611 904 consensus_queue.cc:260] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.338699 904 ts_tablet_manager.cc:1428] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.338771 910 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.338886 910 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.338935 908 tablet_bootstrap.cc:492] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: No bootstrap required, opened a new log
I20260928 20:15:21.338989 908 ts_tablet_manager.cc:1397] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:21.339114 908 raft_consensus.cc:348] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.339205 908 raft_consensus.cc:374] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.339229 908 raft_consensus.cc:729] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.339280 908 consensus_queue.cc:260] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.339377 908 ts_tablet_manager.cc:1428] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.339409 913 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.339509 913 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.548069 907 raft_consensus.cc:482] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:21.548175 907 raft_consensus.cc:504] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.548337 907 leader_election.cc:288] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.548554 689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad7ef39ef03d4f17a08aa773ac570162" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b816f72e006244f4abd44295ebc8e3a4" is_pre_election: true
I20260928 20:15:21.548568 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad7ef39ef03d4f17a08aa773ac570162" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" is_pre_election: true
I20260928 20:15:21.548668 689 raft_consensus.cc:2454] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 0.
I20260928 20:15:21.548663 829 raft_consensus.cc:2454] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 0.
I20260928 20:15:21.548844 481 leader_election.cc:302] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, 54af42b4f8d74a6580f4fee5de2f0fb0; no voters:
I20260928 20:15:21.548966 907 raft_consensus.cc:2781] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:21.549024 907 raft_consensus.cc:482] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:21.549041 907 raft_consensus.cc:3037] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.549723 907 raft_consensus.cc:504] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.549866 907 leader_election.cc:288] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 election: Requested vote from peers b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.550061 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad7ef39ef03d4f17a08aa773ac570162" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
I20260928 20:15:21.550053 689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ad7ef39ef03d4f17a08aa773ac570162" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b816f72e006244f4abd44295ebc8e3a4"
I20260928 20:15:21.550138 689 raft_consensus.cc:3037] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.550138 829 raft_consensus.cc:3037] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.550990 689 raft_consensus.cc:2454] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 1.
I20260928 20:15:21.550990 829 raft_consensus.cc:2454] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 1.
I20260928 20:15:21.551193 481 leader_election.cc:302] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, 54af42b4f8d74a6580f4fee5de2f0fb0; no voters:
I20260928 20:15:21.551303 907 raft_consensus.cc:2781] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:21.551378 907 raft_consensus.cc:686] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 LEADER]: Becoming Leader. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Running, Role: LEADER
I20260928 20:15:21.551426 907 consensus_queue.cc:237] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.551688 934 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: TxnStatusTablet state changed. Reason: New leader 4fdeeb5a0dce43a19fe1c7b3ca935c11. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.551788 934 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:15:21.551936 946 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260928 20:15:21.552044 946 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260928 20:15:21.552032 391 catalog_manager.cc:5495] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1). New cstate: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:21.567960 941 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.564987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:38177 (local address 127.0.0.1:50230)
0928 20:15:21.565118 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:21.565131 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:21.565180 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:21.565420 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:21.565421 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:21.565423 (+ 2us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:15:21.565478 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.565483 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.566193 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.566195 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.566981 (+ 786us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.566985 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.567395 (+ 410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.567396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.567466 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.567484 (+ 18us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.567778 (+ 294us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.567787 (+ 9us) client_negotiation.cc:769] Sending connection context
0928 20:15:21.567829 (+ 42us) client_negotiation.cc:240] Negotiation successful
0928 20:15:21.567879 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":96}
I20260928 20:15:21.567975 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.565059 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50230 (local address 127.24.190.1:38177)
0928 20:15:21.565261 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.565263 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.565271 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:21.565318 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.565320 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.565342 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.565416 (+ 74us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:21.565557 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.566088 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.567074 (+ 986us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.567305 (+ 231us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.567391 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.567591 (+ 200us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.567708 (+ 117us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.567816 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.567835 (+ 19us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.567856 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":182,"thread_start_us":48,"threads_started":1}
I20260928 20:15:21.569103 829 raft_consensus.cc:1261] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Refusing update from remote peer 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.569216 689 raft_consensus.cc:1261] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Refusing update from remote peer 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.569511 934 consensus_queue.cc:1035] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.569721 934 consensus_queue.cc:1035] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.570174 910 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: TxnStatusTablet state changed. Reason: New leader 4fdeeb5a0dce43a19fe1c7b3ca935c11. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.570287 910 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.570366 913 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: TxnStatusTablet state changed. Reason: New leader 4fdeeb5a0dce43a19fe1c7b3ca935c11. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.570461 913 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.571432 934 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.571519 934 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:15:21.571587 934 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.571641 934 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 4fdeeb5a0dce43a19fe1c7b3ca935c11: This TxnStatusTablet replica's current role is: LEADER
I20260928 20:15:21.571594 913 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.571669 913 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P b816f72e006244f4abd44295ebc8e3a4: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.572032 910 tablet_replica.cc:439] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } } }
I20260928 20:15:21.572119 910 tablet_replica.cc:442] T ad7ef39ef03d4f17a08aa773ac570162 P 54af42b4f8d74a6580f4fee5de2f0fb0: This TxnStatusTablet replica's current role is: FOLLOWER
I20260928 20:15:21.576779 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.574021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50232 (local address 127.24.190.1:38177)
0928 20:15:21.574056 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.574058 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.574110 (+ 52us) server_negotiation.cc:407] Connection header received
0928 20:15:21.574320 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.574321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.574332 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.574398 (+ 66us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:21.574546 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.575005 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.576092 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.576370 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.576427 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.576591 (+ 164us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.576616 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.576652 (+ 36us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.576715 (+ 63us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.576731 (+ 16us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260928 20:15:21.581920 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.579412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:44515 (local address 127.24.190.1:38177)
0928 20:15:21.579448 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.579450 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.579578 (+ 128us) server_negotiation.cc:407] Connection header received
0928 20:15:21.579674 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.579675 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.579683 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.579756 (+ 73us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:21.579893 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.580411 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.581202 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.581391 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.581461 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.581647 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.581682 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.581740 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.581791 (+ 51us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.581816 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":18}
I20260928 20:15:21.581947 963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.579342 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:38177 (local address 127.24.190.1:44515)
0928 20:15:21.579507 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:21.579516 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:21.579588 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:21.579758 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:21.579759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:21.579772 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0928 20:15:21.579828 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.579829 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.580499 (+ 670us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.580500 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.581098 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:21.581099 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.581474 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.581475 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:21.581541 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.581554 (+ 13us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.581740 (+ 186us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.581743 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:21.581791 (+ 48us) client_negotiation.cc:240] Negotiation successful
0928 20:15:21.581834 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":86,"threads_started":1}
I20260928 20:15:21.584299 689 raft_consensus.cc:1261] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Refusing update from remote peer 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.584446 829 raft_consensus.cc:1261] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Refusing update from remote peer 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.584573 957 consensus_queue.cc:1035] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.584695 934 consensus_queue.cc:1035] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.599138 391 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.599257 391 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:43572:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.599956 391 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Sending DeleteTablet for 3 replicas of tablet 9fca7e14616741b0a7a34509876f752b
I20260928 20:15:21.600260 809 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fca7e14616741b0a7a34509876f752b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:49044
I20260928 20:15:21.600513 967 tablet_replica.cc:330] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: stopping tablet replica
I20260928 20:15:21.600632 669 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fca7e14616741b0a7a34509876f752b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:58874
I20260928 20:15:21.600677 967 raft_consensus.cc:2229] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.600725 967 raft_consensus.cc:2258] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.600984 967 ts_tablet_manager.cc:1905] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.602854 967 ts_tablet_manager.cc:1918] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:15:21.602921 967 log.cc:1196] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/9fca7e14616741b0a7a34509876f752b
I20260928 20:15:21.603149 967 ts_tablet_manager.cc:1939] T 9fca7e14616741b0a7a34509876f752b P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting consensus metadata
I20260928 20:15:21.603562 529 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fca7e14616741b0a7a34509876f752b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50222
I20260928 20:15:21.603583 376 catalog_manager.cc:4841] TS 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943): tablet 9fca7e14616741b0a7a34509876f752b (table test-table [id=fb02a7b959e04be99db183774909227c]) successfully deleted
I20260928 20:15:21.603755 968 tablet_replica.cc:330] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: stopping tablet replica
I20260928 20:15:21.603829 968 raft_consensus.cc:2229] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.603875 968 raft_consensus.cc:2258] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.603988 970 tablet_replica.cc:330] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: stopping tablet replica
I20260928 20:15:21.604038 970 raft_consensus.cc:2229] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:21.604133 970 raft_consensus.cc:2258] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.604326 968 ts_tablet_manager.cc:1905] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.606222 968 ts_tablet_manager.cc:1918] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:15:21.606307 968 log.cc:1196] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/9fca7e14616741b0a7a34509876f752b
I20260928 20:15:21.606526 968 ts_tablet_manager.cc:1939] T 9fca7e14616741b0a7a34509876f752b P b816f72e006244f4abd44295ebc8e3a4: Deleting consensus metadata
I20260928 20:15:21.606863 970 ts_tablet_manager.cc:1905] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.607091 375 catalog_manager.cc:4841] TS b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091): tablet 9fca7e14616741b0a7a34509876f752b (table test-table [id=fb02a7b959e04be99db183774909227c]) successfully deleted
I20260928 20:15:21.608489 970 ts_tablet_manager.cc:1918] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:15:21.608551 970 log.cc:1196] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/9fca7e14616741b0a7a34509876f752b
I20260928 20:15:21.608781 970 ts_tablet_manager.cc:1939] T 9fca7e14616741b0a7a34509876f752b P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting consensus metadata
I20260928 20:15:21.609390 375 catalog_manager.cc:4841] TS 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177): tablet 9fca7e14616741b0a7a34509876f752b (table test-table [id=fb02a7b959e04be99db183774909227c]) successfully deleted
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[346](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 20:15:21.631268 443 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:21.624796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43580 (local address 127.24.190.62:37943)
0928 20:15:21.624877 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.624879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.624990 (+ 111us) server_negotiation.cc:407] Connection header received
0928 20:15:21.625047 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.625049 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.625058 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.625133 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:21.625819 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.626377 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.627412 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.627599 (+ 187us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.627657 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.631183 (+ 3526us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43580: BlockingRecv error: recv got EOF from 127.0.0.1:43580 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[346](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626521, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM
I20260928 20:15:21.639654 443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.632159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43582 (local address 127.24.190.62:37943)
0928 20:15:21.632227 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.632236 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.632245 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:21.632308 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.632309 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.632318 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.632366 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:21.632835 (+ 469us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.633320 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.634011 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.634216 (+ 205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.634321 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.636652 (+ 2331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:21.636654 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:21.636654 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:21.636662 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:21.638376 (+ 1714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:21.638719 (+ 343us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:21.638721 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:21.638721 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:21.638821 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:21.639056 (+ 235us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:21.639057 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:21.639058 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:21.639178 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:21.639285 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.639458 (+ 173us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.639545 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:15:21.641381 391 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:21.641543 391 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:21.643118 529 tablet_service.cc:1467] Processing CreateTablet for tablet f2cb9a549e984194a600e0d39b67be2f (DEFAULT_TABLE table=test-table [id=98ccf74cc8e747509832dbe904a85a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.643136 669 tablet_service.cc:1467] Processing CreateTablet for tablet f2cb9a549e984194a600e0d39b67be2f (DEFAULT_TABLE table=test-table [id=98ccf74cc8e747509832dbe904a85a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.643172 809 tablet_service.cc:1467] Processing CreateTablet for tablet f2cb9a549e984194a600e0d39b67be2f (DEFAULT_TABLE table=test-table [id=98ccf74cc8e747509832dbe904a85a1a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.643256 529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2cb9a549e984194a600e0d39b67be2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.643277 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2cb9a549e984194a600e0d39b67be2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.643306 809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f2cb9a549e984194a600e0d39b67be2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.644582 908 tablet_bootstrap.cc:492] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Bootstrap starting.
I20260928 20:15:21.644580 903 tablet_bootstrap.cc:492] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Bootstrap starting.
I20260928 20:15:21.644719 904 tablet_bootstrap.cc:492] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Bootstrap starting.
I20260928 20:15:21.644936 908 tablet_bootstrap.cc:654] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.644990 903 tablet_bootstrap.cc:654] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.645174 904 tablet_bootstrap.cc:654] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.645646 903 tablet_bootstrap.cc:492] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: No bootstrap required, opened a new log
I20260928 20:15:21.645699 903 ts_tablet_manager.cc:1397] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:21.645870 903 raft_consensus.cc:348] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.645956 903 raft_consensus.cc:374] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.645973 908 tablet_bootstrap.cc:492] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: No bootstrap required, opened a new log
I20260928 20:15:21.645987 903 raft_consensus.cc:729] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.646013 908 ts_tablet_manager.cc:1397] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:21.646030 903 consensus_queue.cc:260] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.646150 903 ts_tablet_manager.cc:1428] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:21.646149 908 raft_consensus.cc:348] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.646216 908 raft_consensus.cc:374] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.646262 908 raft_consensus.cc:729] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.646333 908 consensus_queue.cc:260] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.646436 908 ts_tablet_manager.cc:1428] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.646739 904 tablet_bootstrap.cc:492] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: No bootstrap required, opened a new log
I20260928 20:15:21.646790 904 ts_tablet_manager.cc:1397] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:15:21.646951 904 raft_consensus.cc:348] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.647017 904 raft_consensus.cc:374] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.647038 904 raft_consensus.cc:729] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54af42b4f8d74a6580f4fee5de2f0fb0, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.647087 904 consensus_queue.cc:260] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.647187 904 ts_tablet_manager.cc:1428] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.736838 913 raft_consensus.cc:482] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:21.736953 913 raft_consensus.cc:504] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.737150 913 leader_election.cc:288] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.737447 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cb9a549e984194a600e0d39b67be2f" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" is_pre_election: true
I20260928 20:15:21.737468 549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cb9a549e984194a600e0d39b67be2f" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" is_pre_election: true
I20260928 20:15:21.737545 829 raft_consensus.cc:2454] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 0.
I20260928 20:15:21.737560 549 raft_consensus.cc:2454] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 0.
I20260928 20:15:21.737701 621 leader_election.cc:302] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, 54af42b4f8d74a6580f4fee5de2f0fb0, b816f72e006244f4abd44295ebc8e3a4; no voters:
I20260928 20:15:21.737825 913 raft_consensus.cc:2781] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:21.737869 913 raft_consensus.cc:482] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:21.737883 913 raft_consensus.cc:3037] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.738633 913 raft_consensus.cc:504] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.738786 913 leader_election.cc:288] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 election: Requested vote from peers 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.738941 549 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cb9a549e984194a600e0d39b67be2f" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11"
I20260928 20:15:21.739025 549 raft_consensus.cc:3037] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.739028 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f2cb9a549e984194a600e0d39b67be2f" candidate_uuid: "b816f72e006244f4abd44295ebc8e3a4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
I20260928 20:15:21.739123 829 raft_consensus.cc:3037] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.739653 549 raft_consensus.cc:2454] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 1.
I20260928 20:15:21.739856 620 leader_election.cc:302] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, b816f72e006244f4abd44295ebc8e3a4; no voters:
I20260928 20:15:21.739900 829 raft_consensus.cc:2454] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b816f72e006244f4abd44295ebc8e3a4 in term 1.
I20260928 20:15:21.740017 913 raft_consensus.cc:2781] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:21.740206 913 raft_consensus.cc:686] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 1 LEADER]: Becoming Leader. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Running, Role: LEADER
I20260928 20:15:21.740271 913 consensus_queue.cc:237] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.740965 390 catalog_manager.cc:5495] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "b816f72e006244f4abd44295ebc8e3a4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:21.765825 988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.762912 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58902 (local address 127.24.190.2:43091)
0928 20:15:21.763044 (+ 132us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.763046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.763056 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:21.763085 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.763086 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.763099 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.763171 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:21.763319 (+ 148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.764069 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.764943 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.765235 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.765310 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.765452 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.765487 (+ 35us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.765546 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.765710 (+ 164us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.765736 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":60,"threads_started":1}
I20260928 20:15:21.766723 829 raft_consensus.cc:1261] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Refusing update from remote peer b816f72e006244f4abd44295ebc8e3a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.766768 549 raft_consensus.cc:1261] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Refusing update from remote peer b816f72e006244f4abd44295ebc8e3a4: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.766991 985 consensus_queue.cc:1035] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.767114 913 consensus_queue.cc:1035] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.769984 390 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.770087 390 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.770763 390 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Sending DeleteTablet for 3 replicas of tablet f2cb9a549e984194a600e0d39b67be2f
I20260928 20:15:21.771030 529 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cb9a549e984194a600e0d39b67be2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50222
I20260928 20:15:21.771130 970 tablet_replica.cc:330] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: stopping tablet replica
I20260928 20:15:21.771214 970 raft_consensus.cc:2229] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.771263 970 raft_consensus.cc:2258] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.771463 669 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cb9a549e984194a600e0d39b67be2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:58874
I20260928 20:15:21.771553 968 tablet_replica.cc:330] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: stopping tablet replica
I20260928 20:15:21.771541 970 ts_tablet_manager.cc:1905] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.771610 968 raft_consensus.cc:2229] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:21.771679 968 raft_consensus.cc:2258] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.771940 809 tablet_service.cc:1514] Processing DeleteTablet for tablet f2cb9a549e984194a600e0d39b67be2f with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:49044
I20260928 20:15:21.772033 967 tablet_replica.cc:330] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: stopping tablet replica
I20260928 20:15:21.772089 967 raft_consensus.cc:2229] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.772135 967 raft_consensus.cc:2258] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.772398 968 ts_tablet_manager.cc:1905] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.773492 970 ts_tablet_manager.cc:1918] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:21.773582 970 log.cc:1196] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/f2cb9a549e984194a600e0d39b67be2f
I20260928 20:15:21.773931 970 ts_tablet_manager.cc:1939] T f2cb9a549e984194a600e0d39b67be2f P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Deleting consensus metadata
I20260928 20:15:21.773970 968 ts_tablet_manager.cc:1918] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:21.774024 968 log.cc:1196] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/f2cb9a549e984194a600e0d39b67be2f
I20260928 20:15:21.774245 968 ts_tablet_manager.cc:1939] T f2cb9a549e984194a600e0d39b67be2f P b816f72e006244f4abd44295ebc8e3a4: Deleting consensus metadata
I20260928 20:15:21.774362 375 catalog_manager.cc:4841] TS 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177): tablet f2cb9a549e984194a600e0d39b67be2f (table test-table [id=98ccf74cc8e747509832dbe904a85a1a]) successfully deleted
I20260928 20:15:21.774436 390 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43582:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:21.774593 390 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:21.775055 375 catalog_manager.cc:4841] TS b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091): tablet f2cb9a549e984194a600e0d39b67be2f (table test-table [id=98ccf74cc8e747509832dbe904a85a1a]) successfully deleted
I20260928 20:15:21.775249 967 ts_tablet_manager.cc:1905] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.776171 809 tablet_service.cc:1467] Processing CreateTablet for tablet da7ab9a9b8d94f3c9a6f13126f210d8d (DEFAULT_TABLE table=test-table [id=15ef1c6ce5464be3b3d1b2ae04361cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.776170 669 tablet_service.cc:1467] Processing CreateTablet for tablet da7ab9a9b8d94f3c9a6f13126f210d8d (DEFAULT_TABLE table=test-table [id=15ef1c6ce5464be3b3d1b2ae04361cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.776288 809 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7ab9a9b8d94f3c9a6f13126f210d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.776299 669 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7ab9a9b8d94f3c9a6f13126f210d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.776748 967 ts_tablet_manager.cc:1918] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:21.776800 967 log.cc:1196] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/f2cb9a549e984194a600e0d39b67be2f
I20260928 20:15:21.777012 967 ts_tablet_manager.cc:1939] T f2cb9a549e984194a600e0d39b67be2f P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting consensus metadata
I20260928 20:15:21.777603 904 tablet_bootstrap.cc:492] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Bootstrap starting.
I20260928 20:15:21.777627 908 tablet_bootstrap.cc:492] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Bootstrap starting.
I20260928 20:15:21.777917 908 tablet_bootstrap.cc:654] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.778010 904 tablet_bootstrap.cc:654] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.778241 529 tablet_service.cc:1467] Processing CreateTablet for tablet da7ab9a9b8d94f3c9a6f13126f210d8d (DEFAULT_TABLE table=test-table [id=15ef1c6ce5464be3b3d1b2ae04361cbe]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:21.778390 529 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet da7ab9a9b8d94f3c9a6f13126f210d8d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:21.778913 904 tablet_bootstrap.cc:492] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: No bootstrap required, opened a new log
I20260928 20:15:21.778955 904 ts_tablet_manager.cc:1397] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:21.779106 904 raft_consensus.cc:348] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.779173 904 raft_consensus.cc:374] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.779193 904 raft_consensus.cc:729] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54af42b4f8d74a6580f4fee5de2f0fb0, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.779244 904 consensus_queue.cc:260] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.779335 904 ts_tablet_manager.cc:1428] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.779590 903 tablet_bootstrap.cc:492] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Bootstrap starting.
I20260928 20:15:21.779920 903 tablet_bootstrap.cc:654] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:21.780174 908 tablet_bootstrap.cc:492] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: No bootstrap required, opened a new log
I20260928 20:15:21.780224 908 ts_tablet_manager.cc:1397] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s
I20260928 20:15:21.780316 908 raft_consensus.cc:348] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.780367 908 raft_consensus.cc:374] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.780381 908 raft_consensus.cc:729] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b816f72e006244f4abd44295ebc8e3a4, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.780421 908 consensus_queue.cc:260] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.780519 908 ts_tablet_manager.cc:1428] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:21.781174 376 catalog_manager.cc:4841] TS 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943): tablet f2cb9a549e984194a600e0d39b67be2f (table test-table [id=98ccf74cc8e747509832dbe904a85a1a]) successfully deleted
I20260928 20:15:21.781489 903 tablet_bootstrap.cc:492] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11: No bootstrap required, opened a new log
I20260928 20:15:21.781546 903 ts_tablet_manager.cc:1397] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:21.781697 903 raft_consensus.cc:348] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.781771 903 raft_consensus.cc:374] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:21.781793 903 raft_consensus.cc:729] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Initialized, Role: FOLLOWER
I20260928 20:15:21.781834 903 consensus_queue.cc:260] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.781929 903 ts_tablet_manager.cc:1428] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11: Time spent starting tablet: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:21.845502 934 raft_consensus.cc:482] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:21.845608 934 raft_consensus.cc:504] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.845772 934 leader_election.cc:288] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.846014 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ab9a9b8d94f3c9a6f13126f210d8d" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" is_pre_election: true
I20260928 20:15:21.846014 689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ab9a9b8d94f3c9a6f13126f210d8d" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b816f72e006244f4abd44295ebc8e3a4" is_pre_election: true
I20260928 20:15:21.846122 829 raft_consensus.cc:2454] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 0.
I20260928 20:15:21.846122 689 raft_consensus.cc:2454] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 0.
I20260928 20:15:21.846328 480 leader_election.cc:302] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, b816f72e006244f4abd44295ebc8e3a4; no voters:
I20260928 20:15:21.846433 934 raft_consensus.cc:2781] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:21.846473 934 raft_consensus.cc:482] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:21.846498 934 raft_consensus.cc:3037] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.847218 934 raft_consensus.cc:504] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.847368 934 leader_election.cc:288] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 election: Requested vote from peers b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091), 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943)
I20260928 20:15:21.847537 829 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ab9a9b8d94f3c9a6f13126f210d8d" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0"
I20260928 20:15:21.847537 689 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "da7ab9a9b8d94f3c9a6f13126f210d8d" candidate_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b816f72e006244f4abd44295ebc8e3a4"
I20260928 20:15:21.847620 689 raft_consensus.cc:3037] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.847620 829 raft_consensus.cc:3037] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:21.848351 829 raft_consensus.cc:2454] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 1.
I20260928 20:15:21.848351 689 raft_consensus.cc:2454] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4fdeeb5a0dce43a19fe1c7b3ca935c11 in term 1.
I20260928 20:15:21.848554 481 leader_election.cc:302] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4fdeeb5a0dce43a19fe1c7b3ca935c11, 54af42b4f8d74a6580f4fee5de2f0fb0; no voters:
I20260928 20:15:21.848644 934 raft_consensus.cc:2781] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:21.848694 934 raft_consensus.cc:686] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 LEADER]: Becoming Leader. State: Replica: 4fdeeb5a0dce43a19fe1c7b3ca935c11, State: Running, Role: LEADER
I20260928 20:15:21.848739 934 consensus_queue.cc:237] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } }
I20260928 20:15:21.849308 390 catalog_manager.cc:5495] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1). New cstate: current_term: 1 leader_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4fdeeb5a0dce43a19fe1c7b3ca935c11" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 38177 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:21.858196 949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.856190 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50244 (local address 127.24.190.1:38177)
0928 20:15:21.856244 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:21.856246 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:21.856255 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:21.856276 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:21.856277 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:21.856287 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:21.856342 (+ 55us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:21.856433 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.856913 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.857642 (+ 729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:21.857868 (+ 226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:21.857924 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:21.858030 (+ 106us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:21.858055 (+ 25us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:21.858089 (+ 34us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:21.858127 (+ 38us) server_negotiation.cc:299] Negotiation successful
0928 20:15:21.858141 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 20:15:21.860320 829 raft_consensus.cc:1261] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Refusing update from remote peer 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.860396 689 raft_consensus.cc:1261] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Refusing update from remote peer 4fdeeb5a0dce43a19fe1c7b3ca935c11: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:21.860530 957 consensus_queue.cc:1035] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54af42b4f8d74a6580f4fee5de2f0fb0" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38943 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.860728 957 consensus_queue.cc:1035] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b816f72e006244f4abd44295ebc8e3a4" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 43091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:21.873085 391 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.873270 391 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:43582:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:21.873862 391 catalog_manager.cc:5782] T 00000000000000000000000000000000 P cfecf87ac5464143abbb102a01427d99: Sending DeleteTablet for 3 replicas of tablet da7ab9a9b8d94f3c9a6f13126f210d8d
I20260928 20:15:21.874089 809 tablet_service.cc:1514] Processing DeleteTablet for tablet da7ab9a9b8d94f3c9a6f13126f210d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:49044
I20260928 20:15:21.874143 529 tablet_service.cc:1514] Processing DeleteTablet for tablet da7ab9a9b8d94f3c9a6f13126f210d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50222
I20260928 20:15:21.874130 669 tablet_service.cc:1514] Processing DeleteTablet for tablet da7ab9a9b8d94f3c9a6f13126f210d8d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:21 UTC) from {username='oryx', principal='oryx/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:58874
I20260928 20:15:21.874198 967 tablet_replica.cc:330] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: stopping tablet replica
I20260928 20:15:21.874228 968 tablet_replica.cc:330] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: stopping tablet replica
I20260928 20:15:21.874243 967 raft_consensus.cc:2229] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.874303 967 raft_consensus.cc:2258] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.874348 968 raft_consensus.cc:2229] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:21.874365 970 tablet_replica.cc:330] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11: stopping tablet replica
I20260928 20:15:21.874395 968 raft_consensus.cc:2258] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.874372 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 464
I20260928 20:15:21.874420 970 raft_consensus.cc:2229] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:21.874472 970 raft_consensus.cc:2258] T da7ab9a9b8d94f3c9a6f13126f210d8d P 4fdeeb5a0dce43a19fe1c7b3ca935c11 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:21.875327 968 ts_tablet_manager.cc:1905] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.876672 967 ts_tablet_manager.cc:1905] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:21.877221 968 ts_tablet_manager.cc:1918] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:15:21.877269 968 log.cc:1196] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/da7ab9a9b8d94f3c9a6f13126f210d8d
I20260928 20:15:21.877491 968 ts_tablet_manager.cc:1939] T da7ab9a9b8d94f3c9a6f13126f210d8d P b816f72e006244f4abd44295ebc8e3a4: Deleting consensus metadata
I20260928 20:15:21.877789 375 catalog_manager.cc:4841] TS b816f72e006244f4abd44295ebc8e3a4 (127.24.190.2:43091): tablet da7ab9a9b8d94f3c9a6f13126f210d8d (table test-table [id=15ef1c6ce5464be3b3d1b2ae04361cbe]) successfully deleted
I20260928 20:15:21.878063 967 ts_tablet_manager.cc:1918] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260928 20:15:21.878135 967 log.cc:1196] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/da7ab9a9b8d94f3c9a6f13126f210d8d
I20260928 20:15:21.878396 967 ts_tablet_manager.cc:1939] T da7ab9a9b8d94f3c9a6f13126f210d8d P 54af42b4f8d74a6580f4fee5de2f0fb0: Deleting consensus metadata
I20260928 20:15:21.878723 376 catalog_manager.cc:4841] TS 54af42b4f8d74a6580f4fee5de2f0fb0 (127.24.190.3:38943): tablet da7ab9a9b8d94f3c9a6f13126f210d8d (table test-table [id=15ef1c6ce5464be3b3d1b2ae04361cbe]) successfully deleted
W20260928 20:15:21.882969 375 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:38177 (error 108)
I20260928 20:15:21.883178 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 604
I20260928 20:15:21.884500 1000 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:21.884259 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:38177 (local address 127.0.0.1:50250)
0928 20:15:21.884407 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:21.884448 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:38177: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":43,"threads_started":1}
W20260928 20:15:21.884593 375 catalog_manager.cc:4584] TS 4fdeeb5a0dce43a19fe1c7b3ca935c11 (127.24.190.1:38177): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet da7ab9a9b8d94f3c9a6f13126f210d8d: Network error: Client connection negotiation failed: client connection to 127.24.190.1:38177: connect: Connection refused (error 111)
I20260928 20:15:21.888957 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 744
I20260928 20:15:21.893939 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 359
2026-09-28T20:15:21Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (2874 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[1003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[1003](info): set up 2 sockets
Sep 28 20:15:21 dist-test-slave-n45k krb5kdc[1003](info): commencing operation
krb5kdc: starting...
W20260928 20:15:22.935356 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:23 dist-test-slave-n45k krb5kdc[1003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626523, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:15:23.057642 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:44773
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:36115
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:44773
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:23.140892 1016 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:23.141144 1016 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:23.141181 1016 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:23.142398 1016 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:23.142468 1016 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:23.142491 1016 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:23.142513 1016 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:23.142544 1016 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:23.144027 1016 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:36115
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:44773
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:44773
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1016
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:23.144316 1016 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:23.144548 1016 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:23.149387 1021 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:23.149415 1024 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:23.149387 1022 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:23.149829 1016 server_base.cc:1034] running on GCE node
I20260928 20:15:23.150058 1016 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:23.150354 1016 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:23.151506 1016 hybrid_clock.cc:648] HybridClock initialized: now 1790626523151492 us; error 30 us; skew 500 ppm
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-09-28T20:15:23Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (1260 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:23 dist-test-slave-n45k krb5kdc[1029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:23 dist-test-slave-n45k krb5kdc[1029](info): set up 2 sockets
Sep 28 20:15:23 dist-test-slave-n45k krb5kdc[1029](info): commencing operation
krb5kdc: starting...
W20260928 20:15:24.207325 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:15:24.331159 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43865
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:24.416585 1042 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:24.416792 1042 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:24.416814 1042 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:24.417894 1042 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:24.417932 1042 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:24.417946 1042 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:24.417959 1042 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:24.417971 1042 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:24.419377 1042 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1042
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:24.419569 1042 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:24.419729 1042 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:24.424642 1050 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.424672 1048 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:24.424705 1042 server_base.cc:1034] running on GCE node
W20260928 20:15:24.424649 1047 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:24.425065 1042 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:24.425328 1042 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:24.426474 1042 hybrid_clock.cc:648] HybridClock initialized: now 1790626524426463 us; error 31 us; skew 500 ppm
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:24.428943 1042 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:24.429418 1042 webserver.cc:460] Webserver started at http://127.24.190.62:41537/ using document root <none> and password file <none>
I20260928 20:15:24.429658 1042 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:24.429724 1042 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:24.429878 1042 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:24.430975 1042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "1eee37ae08bb4cadb1b9983c52742afc"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "8d2251e856bb7eafd079ddb354b58f76"
server_key_iv: "12bc92842bd9859dc9b63fe0aa54dabf"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.431326 1042 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "1eee37ae08bb4cadb1b9983c52742afc"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "8d2251e856bb7eafd079ddb354b58f76"
server_key_iv: "12bc92842bd9859dc9b63fe0aa54dabf"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.432651 1042 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:15:24.433482 1057 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.433665 1042 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:24.433789 1042 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "1eee37ae08bb4cadb1b9983c52742afc"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "8d2251e856bb7eafd079ddb354b58f76"
server_key_iv: "12bc92842bd9859dc9b63fe0aa54dabf"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.433867 1042 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:24.442432 1042 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:24.444186 1042 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:24.444353 1042 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:24.448429 1042 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43865
I20260928 20:15:24.448487 1109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43865 every 8 connection(s)
I20260928 20:15:24.448849 1042 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:24.449751 1110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:24.452093 1110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Bootstrap starting.
I20260928 20:15:24.452674 1110 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:24.453017 1110 log.cc:824] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:24.453831 1110 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: No bootstrap required, opened a new log
I20260928 20:15:24.456154 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1042
I20260928 20:15:24.456286 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:24.456471 25336 external_mini_cluster.cc:1428] Setting key a7087bc27c915485fa53f7997e9fa55c
I20260928 20:15:24.456423 1110 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:24.456585 1110 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:24.456629 1110 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eee37ae08bb4cadb1b9983c52742afc, State: Initialized, Role: FOLLOWER
I20260928 20:15:24.456775 1110 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:24.456833 1110 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:24.456882 1110 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:24.456936 1110 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:24.457995 1110 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:24.458087 1110 leader_election.cc:302] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1eee37ae08bb4cadb1b9983c52742afc; no voters:
I20260928 20:15:24.458308 1110 leader_election.cc:288] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:24.458361 1115 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:24.458477 1115 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 LEADER]: Becoming Leader. State: Replica: 1eee37ae08bb4cadb1b9983c52742afc, State: Running, Role: LEADER
I20260928 20:15:24.458565 1110 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:24.458554 1115 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:24.458869 1115 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eee37ae08bb4cadb1b9983c52742afc. Latest consensus state: current_term: 1 leader_uuid: "1eee37ae08bb4cadb1b9983c52742afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } } }
I20260928 20:15:24.458951 1115 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:24.458879 1117 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1eee37ae08bb4cadb1b9983c52742afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } } }
I20260928 20:15:24.459106 1117 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: This master's current role is: LEADER
W20260928 20:15:24.460414 1130 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:15:24.460474 1130 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:15:24.460602 1120 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:24.460763 1120 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:24.462345 1120 catalog_manager.cc:1347] Generated new cluster ID: 31449df654d64e3390463fae7bb67255
I20260928 20:15:24.462400 1120 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:24.471992 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.457071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48868 (local address 127.24.190.62:43865)
0928 20:15:24.457280 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:24.457290 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:24.457324 (+ 34us) server_negotiation.cc:407] Connection header received
0928 20:15:24.457459 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:24.457466 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:24.457533 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:24.457732 (+ 199us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:24.458463 (+ 731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.459654 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.460684 (+ 1030us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.461283 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.461404 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.468373 (+ 6969us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:24.468377 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:24.468378 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:24.468391 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:24.470372 (+ 1981us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.470783 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.470786 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.470786 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.470886 (+ 100us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.471092 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.471093 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.471093 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.471390 (+ 297us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:24.471521 (+ 131us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:24.471641 (+ 120us) server_negotiation.cc:299] Negotiation successful
0928 20:15:24.471768 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":152,"thread_start_us":102,"threads_started":1}
I20260928 20:15:24.481738 1120 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:24.482311 1120 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:24.490396 1120 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Generated new TSK 0
I20260928 20:15:24.490573 1120 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:15:24.525324 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43865
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:24.623230 1136 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:24.623425 1136 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:24.623447 1136 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:24.624526 1136 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:24.624558 1136 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:24.624584 1136 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:24.625917 1136 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1136
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:24.626103 1136 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:24.626289 1136 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:24.631335 1141 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.631433 1142 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.631361 1144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:24.631595 1136 server_base.cc:1034] running on GCE node
I20260928 20:15:24.631852 1136 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:24.632091 1136 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:24.633268 1136 hybrid_clock.cc:648] HybridClock initialized: now 1790626524633264 us; error 38 us; skew 500 ppm
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:24.635939 1136 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:15:24.636490 1136 webserver.cc:460] Webserver started at http://127.24.190.1:37307/ using document root <none> and password file <none>
I20260928 20:15:24.636756 1136 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:24.636811 1136 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:24.636907 1136 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:24.637972 1136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "849de17257214c42bd7e215a4f9945a3"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "5475ae99a7335a59951a1433b53fc66a"
server_key_iv: "c6ddcb2bc9f9a75219b3a730c1a3daa1"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.638332 1136 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "849de17257214c42bd7e215a4f9945a3"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "5475ae99a7335a59951a1433b53fc66a"
server_key_iv: "c6ddcb2bc9f9a75219b3a730c1a3daa1"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.639585 1136 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:24.640285 1151 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.640486 1136 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:24.640558 1136 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "849de17257214c42bd7e215a4f9945a3"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "5475ae99a7335a59951a1433b53fc66a"
server_key_iv: "c6ddcb2bc9f9a75219b3a730c1a3daa1"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.640610 1136 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:24.655362 1136 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:24.657147 1136 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:24.657255 1136 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:24.657428 1136 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:24.657742 1136 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:24.657774 1136 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.657804 1136 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:24.657851 1136 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.664322 1136 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:42561
I20260928 20:15:24.664397 1264 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:42561 every 8 connection(s)
I20260928 20:15:24.664706 1136 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:24.670855 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1136
I20260928 20:15:24.670969 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:24.671176 25336 external_mini_cluster.cc:1428] Setting key 7e5f84b38d197073bf303e199f15ec40
I20260928 20:15:24.675128 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.665488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:39949 (local address 127.24.190.62:43865)
0928 20:15:24.665564 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:24.665565 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:24.665754 (+ 189us) server_negotiation.cc:407] Connection header received
0928 20:15:24.666235 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:24.666236 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:24.666245 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:24.666360 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:24.667283 (+ 923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.667789 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.668750 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.668970 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.669027 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.671269 (+ 2242us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:24.671270 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:24.671271 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:24.671279 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:24.673283 (+ 2004us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.673830 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.673831 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.673832 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.673901 (+ 69us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.674236 (+ 335us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.674238 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.674238 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.674425 (+ 187us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:24.674476 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:24.674889 (+ 413us) server_negotiation.cc:299] Negotiation successful
0928 20:15:24.674992 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:15:24.675961 1267 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.665454 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:39949)
0928 20:15:24.665626 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:24.665667 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:24.666152 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:24.666433 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:24.666437 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:24.667008 (+ 571us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:24.667198 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:24.667202 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.667868 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.667869 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:24.668670 (+ 801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:24.668672 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.669045 (+ 373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.669045 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:24.669140 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.669689 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:24.669698 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:24.671160 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:24.673408 (+ 2248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:24.673415 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:24.673417 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:24.673730 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:24.673986 (+ 256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:24.673986 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:24.673987 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:24.674137 (+ 150us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:24.674530 (+ 393us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:24.674536 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:24.674699 (+ 163us) client_negotiation.cc:769] Sending connection context
0928 20:15:24.675526 (+ 827us) client_negotiation.cc:240] Negotiation successful
0928 20:15:24.675719 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":131,"thread_start_us":84,"threads_started":1}
I20260928 20:15:24.676486 1265 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43865
I20260928 20:15:24.676604 1265 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:24.676812 1265 heartbeater.cc:511] Master 127.24.190.62:43865 requested a full tablet report, sending...
I20260928 20:15:24.677378 1074 ts_manager.cc:194] Registered new tserver with Master: 849de17257214c42bd7e215a4f9945a3 (127.24.190.1:42561)
I20260928 20:15:24.677987 1074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:39949
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:15:24.699035 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43865
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:24.782775 1270 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:24.782996 1270 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:24.783021 1270 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:24.784332 1270 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:24.784379 1270 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:24.784406 1270 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:24.786006 1270 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1270
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:24.786307 1270 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:24.786566 1270 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:24.792017 1275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.792025 1276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.792052 1278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:24.792042 1270 server_base.cc:1034] running on GCE node
I20260928 20:15:24.792497 1270 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:24.792742 1270 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:24.793884 1270 hybrid_clock.cc:648] HybridClock initialized: now 1790626524793871 us; error 28 us; skew 500 ppm
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:24.796602 1270 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:15:24.797039 1270 webserver.cc:460] Webserver started at http://127.24.190.2:34303/ using document root <none> and password file <none>
I20260928 20:15:24.797277 1270 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:24.797345 1270 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:24.797502 1270 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:24.798619 1270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "5b381b473e254579badb4c18085a8f88"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "83fafd85665005279276eb2c87cfeb10"
server_key_iv: "789575b8e6d6a969e9c280d8d8d5a9be"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.798964 1270 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "5b381b473e254579badb4c18085a8f88"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "83fafd85665005279276eb2c87cfeb10"
server_key_iv: "789575b8e6d6a969e9c280d8d8d5a9be"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.800356 1270 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:24.801110 1285 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.801339 1270 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:24.801445 1270 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "5b381b473e254579badb4c18085a8f88"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "83fafd85665005279276eb2c87cfeb10"
server_key_iv: "789575b8e6d6a969e9c280d8d8d5a9be"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.801529 1270 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:24.815987 1270 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:24.817857 1270 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:24.818034 1270 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:24.818249 1270 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:24.818599 1270 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:24.818637 1270 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.818681 1270 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:24.818707 1270 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.824326 1270 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:43997
I20260928 20:15:24.824424 1399 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:43997 every 8 connection(s)
I20260928 20:15:24.824719 1270 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:24.833894 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1270
I20260928 20:15:24.834025 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:24.834232 25336 external_mini_cluster.cc:1428] Setting key a9d0d7af4c7a2f0db85cc106ade5c13a
I20260928 20:15:24.834419 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.825445 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:50761 (local address 127.24.190.62:43865)
0928 20:15:24.825515 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:24.825517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:24.825684 (+ 167us) server_negotiation.cc:407] Connection header received
0928 20:15:24.826254 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:24.826255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:24.826331 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:24.826408 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:24.827356 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.827882 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.828883 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.829093 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.829181 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.831381 (+ 2200us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:24.831383 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:24.831383 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:24.831392 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:24.832687 (+ 1295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.833141 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.833143 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.833143 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.833208 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.833478 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.833479 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.833479 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.833606 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:24.833685 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:24.834067 (+ 382us) server_negotiation.cc:299] Negotiation successful
0928 20:15:24.834245 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 20:15:24.834491 1403 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.825421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:50761)
0928 20:15:24.825568 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:24.825609 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:24.826128 (+ 519us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:24.826491 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:24.826495 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:24.827056 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:24.827246 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:24.827252 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.827984 (+ 732us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.827985 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:24.828787 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:24.828788 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.829191 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.829192 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:24.829325 (+ 133us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.829813 (+ 488us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:24.829821 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:24.831258 (+ 1437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:24.832819 (+ 1561us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:24.832827 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:24.832829 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:24.833060 (+ 231us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:24.833294 (+ 234us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:24.833295 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:24.833296 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:24.833407 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:24.833675 (+ 268us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:24.833682 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:24.833868 (+ 186us) client_negotiation.cc:769] Sending connection context
0928 20:15:24.833999 (+ 131us) client_negotiation.cc:240] Negotiation successful
0928 20:15:24.834184 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":81,"threads_started":1}
I20260928 20:15:24.835023 1401 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43865
I20260928 20:15:24.835142 1401 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:24.835361 1401 heartbeater.cc:511] Master 127.24.190.62:43865 requested a full tablet report, sending...
I20260928 20:15:24.835750 1074 ts_manager.cc:194] Registered new tserver with Master: 5b381b473e254579badb4c18085a8f88 (127.24.190.2:43997)
I20260928 20:15:24.836261 1074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:50761
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:15:24.861713 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43865
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:24.943970 1406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:24.944257 1406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:24.944298 1406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:24.945482 1406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:24.945549 1406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:24.945593 1406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:24.947029 1406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1406
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:24.947299 1406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:24.947531 1406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:24.952409 1411 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.952437 1412 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:24.952409 1414 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:24.952615 1406 server_base.cc:1034] running on GCE node
I20260928 20:15:24.952876 1406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:24.953068 1406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:24.954231 1406 hybrid_clock.cc:648] HybridClock initialized: now 1790626524954209 us; error 34 us; skew 500 ppm
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:24.956774 1406 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:15:24.957139 1406 webserver.cc:460] Webserver started at http://127.24.190.3:38315/ using document root <none> and password file <none>
I20260928 20:15:24.957373 1406 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:24.957417 1406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:24.957571 1406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:24.958775 1406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "af968ec6e79a4467893791cb65764d80"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "33fceec20845802e897816bb5e98175a"
server_key_iv: "eee60cbcf03b03b213d1139dc6f56cfa"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.959169 1406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "af968ec6e79a4467893791cb65764d80"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "33fceec20845802e897816bb5e98175a"
server_key_iv: "eee60cbcf03b03b213d1139dc6f56cfa"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.960685 1406 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260928 20:15:24.961405 1421 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.961584 1406 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:15:24.961675 1406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "af968ec6e79a4467893791cb65764d80"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "33fceec20845802e897816bb5e98175a"
server_key_iv: "eee60cbcf03b03b213d1139dc6f56cfa"
server_key_version: "encryptionkey@0"
I20260928 20:15:24.961756 1406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:24.980556 1406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:24.982976 1406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:24.983143 1406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:24.983378 1406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:24.983685 1406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:24.983739 1406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.983788 1406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:24.983835 1406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:24.989575 1406 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:37579
I20260928 20:15:24.989697 1535 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:37579 every 8 connection(s)
I20260928 20:15:24.989974 1406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:15:24 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626524, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:24.996884 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1406
I20260928 20:15:24.996954 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:24.997146 25336 external_mini_cluster.cc:1428] Setting key 19d6c4e8226faa04a3523c9174b23d70
I20260928 20:15:25.000500 1114 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.990792 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:50229 (local address 127.24.190.62:43865)
0928 20:15:24.990866 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:24.990868 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:24.991212 (+ 344us) server_negotiation.cc:407] Connection header received
0928 20:15:24.991729 (+ 517us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:24.991730 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:24.991744 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:24.991811 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:24.992856 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.993420 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.994651 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.994873 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.994967 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.997243 (+ 2276us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:24.997244 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:24.997244 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:24.997253 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:24.998969 (+ 1716us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.999446 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.999449 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.999449 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.999517 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:24.999797 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:24.999798 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:24.999799 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:24.999927 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:25.000012 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:25.000314 (+ 302us) server_negotiation.cc:299] Negotiation successful
0928 20:15:25.000398 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 20:15:25.000723 1538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:24.990791 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:50229)
0928 20:15:24.990974 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:24.991011 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:24.991586 (+ 575us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:24.991887 (+ 301us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:24.991891 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:24.992522 (+ 631us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:24.992747 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:24.992752 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.993546 (+ 794us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.993547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:24.994527 (+ 980us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:24.994529 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:24.994977 (+ 448us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:24.994979 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:24.995125 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:24.995594 (+ 469us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:24.995602 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:24.997047 (+ 1445us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:24.999080 (+ 2033us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:24.999087 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:24.999089 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:24.999345 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:24.999598 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:24.999599 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:24.999600 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:24.999720 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:25.000000 (+ 280us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:25.000006 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:25.000167 (+ 161us) client_negotiation.cc:769] Sending connection context
0928 20:15:25.000290 (+ 123us) client_negotiation.cc:240] Negotiation successful
0928 20:15:25.000459 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":92,"threads_started":1}
I20260928 20:15:25.001243 1536 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43865
I20260928 20:15:25.001328 1536 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:25.001539 1536 heartbeater.cc:511] Master 127.24.190.62:43865 requested a full tablet report, sending...
I20260928 20:15:25.001928 1074 ts_manager.cc:194] Registered new tserver with Master: af968ec6e79a4467893791cb65764d80 (127.24.190.3:37579)
I20260928 20:15:25.002391 1074 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:50229
I20260928 20:15:25.008916 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab.
Entry for principal oryx/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab.
WARNING: no policy specified for oryx/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab.
Entry for principal oryx/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab.
WARNING: no policy specified for oryx/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab.
Entry for principal oryx/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab.
I20260928 20:15:25.080914 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1136
I20260928 20:15:25.085512 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1270
I20260928 20:15:25.089630 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1406
I20260928 20:15:25.093864 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1042
I20260928 20:15:25.099051 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43865
--webserver_interface=127.24.190.62
--webserver_port=41537
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43865
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:25.182727 1545 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:25.182940 1545 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:25.182962 1545 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:25.184154 1545 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:25.184197 1545 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:25.184211 1545 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:25.184265 1545 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:25.184300 1545 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:25.185784 1545 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43865
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43865
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=41537
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1545
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:25.186033 1545 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:25.186302 1545 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:15:25.191306 1545 server_base.cc:1034] running on GCE node
W20260928 20:15:25.191233 1553 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:25.191248 1551 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:25.191263 1550 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:25.191680 1545 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:25.191998 1545 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:25.193157 1545 hybrid_clock.cc:648] HybridClock initialized: now 1790626525193115 us; error 61 us; skew 500 ppm
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626525, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:25.195765 1545 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:25.196239 1545 webserver.cc:460] Webserver started at http://127.24.190.62:41537/ using document root <none> and password file <none>
I20260928 20:15:25.196493 1545 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:25.196579 1545 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:25.197962 1545 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.198745 1560 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.198917 1545 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:15:25.199019 1545 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "1eee37ae08bb4cadb1b9983c52742afc"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "8d2251e856bb7eafd079ddb354b58f76"
server_key_iv: "12bc92842bd9859dc9b63fe0aa54dabf"
server_key_version: "encryptionkey@0"
I20260928 20:15:25.199409 1545 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:25.209236 1545 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:25.211092 1545 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:25.211254 1545 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:25.215230 1545 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43865
I20260928 20:15:25.215284 1612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43865 every 8 connection(s)
I20260928 20:15:25.215668 1545 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:25.217047 1613 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:15:25.217677 1613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Bootstrap starting.
I20260928 20:15:25.225294 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1545
I20260928 20:15:25.225601 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:42561
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:43865
--webserver_port=37307
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:15:25.225873 1613 log.cc:824] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:25.228175 1613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:15:25.228483 1613 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Bootstrap complete.
I20260928 20:15:25.232482 1613 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:25.232901 1613 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eee37ae08bb4cadb1b9983c52742afc, State: Initialized, Role: FOLLOWER
I20260928 20:15:25.233093 1613 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:25.233179 1613 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:25.233239 1613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:25.233297 1613 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:15:25.234966 1613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:25.235098 1613 leader_election.cc:302] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1eee37ae08bb4cadb1b9983c52742afc; no voters:
I20260928 20:15:25.235287 1613 leader_election.cc:288] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [CANDIDATE]: Term 2 election: Requested vote from peers
I20260928 20:15:25.235371 1618 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:15:25.235563 1618 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [term 2 LEADER]: Becoming Leader. State: Replica: 1eee37ae08bb4cadb1b9983c52742afc, State: Running, Role: LEADER
I20260928 20:15:25.235575 1613 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:25.235730 1618 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } }
I20260928 20:15:25.236091 1619 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1eee37ae08bb4cadb1b9983c52742afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } } }
I20260928 20:15:25.236176 1619 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:25.236467 1620 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eee37ae08bb4cadb1b9983c52742afc. Latest consensus state: current_term: 2 leader_uuid: "1eee37ae08bb4cadb1b9983c52742afc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1eee37ae08bb4cadb1b9983c52742afc" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43865 } } }
I20260928 20:15:25.236528 1620 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:25.236721 1624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:25.237309 1624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:25.237459 1624 catalog_manager.cc:1259] Loaded cluster ID: 31449df654d64e3390463fae7bb67255
I20260928 20:15:25.237679 1624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:25.238731 1624 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:25.238914 1624 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1eee37ae08bb4cadb1b9983c52742afc: Loaded TSK: 0
I20260928 20:15:25.239123 1624 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 20:15:25.308938 1616 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:25.309193 1616 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:25.309231 1616 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:25.310469 1616 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:25.310539 1616 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:25.310585 1616 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:25.312098 1616 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.1.keytab
--principal=oryx/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:42561
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=37307
--tserver_master_addrs=127.24.190.62:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1616
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:25.312378 1616 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:25.312621 1616 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:25.317704 1644 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:25.317920 1616 server_base.cc:1034] running on GCE node
W20260928 20:15:25.317682 1642 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:25.317692 1641 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:25.318224 1616 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:25.318504 1616 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:25.319690 1616 hybrid_clock.cc:648] HybridClock initialized: now 1790626525319676 us; error 30 us; skew 500 ppm
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626525, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:25.341150 1616 init.cc:377] Logged in from keytab as oryx/127.24.190.1@KRBTEST.COM (short username oryx)
I20260928 20:15:25.341755 1616 webserver.cc:460] Webserver started at http://127.24.190.1:37307/ using document root <none> and password file <none>
I20260928 20:15:25.342007 1616 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:25.342089 1616 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:25.343533 1616 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.344188 1651 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.344426 1616 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.344539 1616 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "849de17257214c42bd7e215a4f9945a3"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "5475ae99a7335a59951a1433b53fc66a"
server_key_iv: "c6ddcb2bc9f9a75219b3a730c1a3daa1"
server_key_version: "encryptionkey@0"
I20260928 20:15:25.345006 1616 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:25.356997 1616 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:25.359613 1616 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:25.359773 1616 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:25.360042 1616 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:25.360381 1616 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:25.360423 1616 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.360451 1616 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:25.360469 1616 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.367349 1616 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:42561
I20260928 20:15:25.367444 1765 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:42561 every 8 connection(s)
I20260928 20:15:25.367852 1616 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:25.371531 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1616
I20260928 20:15:25.371834 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:43997
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:43865
--webserver_port=34303
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.377669 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.368665 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:49071)
0928 20:15:25.368882 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.368928 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.369391 (+ 463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.369939 (+ 548us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.369944 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.370713 (+ 769us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.370997 (+ 284us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.371003 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.372250 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.372252 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.373457 (+ 1205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.373460 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.374557 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.374558 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.374657 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.375233 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.375241 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.377517 (+ 2276us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":118,"threads_started":1}
W20260928 20:15:25.377940 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.368728 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:49071 (local address 127.24.190.62:43865)
0928 20:15:25.369547 (+ 819us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.369554 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.369581 (+ 27us) server_negotiation.cc:407] Connection header received
0928 20:15:25.369673 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.369676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.369716 (+ 40us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.369835 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.371111 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.372142 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.373574 (+ 1432us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.374461 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.374578 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.377721 (+ 3143us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:49071: BlockingRecv error: recv got EOF from 127.24.190.1:49071 (error 108)
Metrics: {"server-negotiator.queue_time_us":775,"thread_start_us":113,"threads_started":1}
W20260928 20:15:25.378111 1766 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:43865 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.190.62:43865: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.382809 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.378492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:46537)
0928 20:15:25.378525 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.378535 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.378599 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.378737 (+ 138us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.378738 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.378904 (+ 166us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.378946 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.378948 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.379592 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.379593 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.380085 (+ 492us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.380086 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.380464 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.380465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.380534 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.381016 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.381020 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.382738 (+ 1718us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":16}
W20260928 20:15:25.382937 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.378548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:46537 (local address 127.24.190.62:43865)
0928 20:15:25.378612 (+ 64us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.378614 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.378622 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:25.378648 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.378648 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.378661 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.378737 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.379028 (+ 291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.379509 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.380183 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.380381 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.380454 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.382842 (+ 2388us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:46537: BlockingRecv error: recv got EOF from 127.24.190.1:46537 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.387392 1768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.383166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:55177)
0928 20:15:25.383223 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.383234 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.383296 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.383439 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.383439 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.383564 (+ 125us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.383589 (+ 25us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.383590 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.384190 (+ 600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.384191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.384684 (+ 493us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.384685 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.385037 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.385038 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.385090 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.385512 (+ 422us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.385516 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.387303 (+ 1787us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":36}
W20260928 20:15:25.387432 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.383248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:55177 (local address 127.24.190.62:43865)
0928 20:15:25.383327 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.383328 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.383337 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:25.383356 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.383357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.383367 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.383435 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.383669 (+ 234us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.384112 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.384769 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.384954 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.385036 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.387390 (+ 2354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:55177: BlockingRecv error: recv got EOF from 127.24.190.1:55177 (error 108)
Metrics: {"server-negotiator.queue_time_us":58}
W20260928 20:15:25.387696 1766 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 20:15:25.459334 1770 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:25.459638 1770 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:25.459678 1770 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:25.461066 1770 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:25.461112 1770 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:25.461139 1770 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:25.462769 1770 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.2.keytab
--principal=oryx/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:43997
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=34303
--tserver_master_addrs=127.24.190.62:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1770
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:25.463001 1770 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:25.463231 1770 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:25.468430 1778 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:25.468466 1776 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:25.468466 1775 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:25.468494 1770 server_base.cc:1034] running on GCE node
I20260928 20:15:25.468787 1770 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:25.468968 1770 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:25.470130 1770 hybrid_clock.cc:648] HybridClock initialized: now 1790626525470115 us; error 27 us; skew 500 ppm
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626525, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:25.472689 1770 init.cc:377] Logged in from keytab as oryx/127.24.190.2@KRBTEST.COM (short username oryx)
I20260928 20:15:25.473141 1770 webserver.cc:460] Webserver started at http://127.24.190.2:34303/ using document root <none> and password file <none>
I20260928 20:15:25.473367 1770 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:25.473424 1770 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:25.474852 1770 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.475478 1785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.475675 1770 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.475801 1770 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "5b381b473e254579badb4c18085a8f88"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "83fafd85665005279276eb2c87cfeb10"
server_key_iv: "789575b8e6d6a969e9c280d8d8d5a9be"
server_key_version: "encryptionkey@0"
I20260928 20:15:25.476171 1770 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:25.485311 1770 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:25.487599 1770 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:25.487758 1770 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:25.487974 1770 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:25.488265 1770 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:25.488317 1770 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.488358 1770 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:25.488385 1770 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.494179 1770 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:43997
I20260928 20:15:25.494226 1898 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:43997 every 8 connection(s)
I20260928 20:15:25.494616 1770 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:25.497290 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1770
I20260928 20:15:25.497581 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:37579
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:43865
--webserver_port=38315
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35205
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 20:15:25.502974 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.495311 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38361 (local address 127.24.190.62:43865)
0928 20:15:25.495360 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.495363 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.495545 (+ 182us) server_negotiation.cc:407] Connection header received
0928 20:15:25.496108 (+ 563us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.496110 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.496128 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.496179 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.497157 (+ 978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.497822 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.499035 (+ 1213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.499228 (+ 193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.499297 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.502890 (+ 3593us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:38361: BlockingRecv error: recv got EOF from 127.24.190.2:38361 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:15:25.503127 1901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.495283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:38361)
0928 20:15:25.495415 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.495462 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.495980 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.496247 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.496251 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.496846 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.497038 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.497043 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.497915 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.497916 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.498940 (+ 1024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.498943 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.499332 (+ 389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.499333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.499480 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.500025 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.500043 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.502858 (+ 2815us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":62,"threads_started":1}
W20260928 20:15:25.503448 1899 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:43865 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.190.62:43865: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.507970 1901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.503691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:51051)
0928 20:15:25.503734 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.503743 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.503784 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.503930 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.503931 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.504064 (+ 133us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.504106 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.504108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.504751 (+ 643us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.504752 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.505265 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.505266 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.505620 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.505621 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.505684 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.506117 (+ 433us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.506122 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.507888 (+ 1766us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":28}
W20260928 20:15:25.508035 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.503747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:51051 (local address 127.24.190.62:43865)
0928 20:15:25.503808 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.503810 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.503818 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:25.503845 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.503846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.503855 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.503926 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.504181 (+ 255us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.504661 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.505346 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.505537 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.505620 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.507970 (+ 2350us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:51051: BlockingRecv error: recv got EOF from 127.24.190.2:51051 (error 108)
Metrics: {"server-negotiator.queue_time_us":36}
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.512661 1901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.508243 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:41569)
0928 20:15:25.508344 (+ 101us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.508355 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.508406 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.508520 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.508521 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.508656 (+ 135us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.508688 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.508689 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.509254 (+ 565us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.509255 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.510063 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.510065 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.510451 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.510452 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.510508 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.510877 (+ 369us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.510881 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.512579 (+ 1698us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":86}
W20260928 20:15:25.512712 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.508296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:41569 (local address 127.24.190.62:43865)
0928 20:15:25.508351 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.508353 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.508393 (+ 40us) server_negotiation.cc:407] Connection header received
0928 20:15:25.508461 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.508462 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.508469 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.508509 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.508753 (+ 244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.509184 (+ 431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.510147 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.510385 (+ 238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.510439 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.512649 (+ 2210us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:41569: BlockingRecv error: recv got EOF from 127.24.190.2:41569 (error 108)
Metrics: {"server-negotiator.queue_time_us":35}
W20260928 20:15:25.512786 1899 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 20:15:25.580922 1903 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:25.581131 1903 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:25.581154 1903 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:25.582363 1903 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:25.582404 1903 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:25.582432 1903 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:25.583861 1903 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35205
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/krb5kdc/oryx_127.24.190.3.keytab
--principal=oryx/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:37579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=38315
--tserver_master_addrs=127.24.190.62:43865
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.1903
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:25.584088 1903 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:25.584334 1903 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:25.589263 1911 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:25.589262 1909 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:25.589485 1903 server_base.cc:1034] running on GCE node
W20260928 20:15:25.589291 1908 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:25.589805 1903 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:25.590042 1903 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:25.591216 1903 hybrid_clock.cc:648] HybridClock initialized: now 1790626525591203 us; error 42 us; skew 500 ppm
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626525, etypes {rep=17 tkt=17 ses=17}, oryx/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:25.593592 1903 init.cc:377] Logged in from keytab as oryx/127.24.190.3@KRBTEST.COM (short username oryx)
I20260928 20:15:25.594080 1903 webserver.cc:460] Webserver started at http://127.24.190.3:38315/ using document root <none> and password file <none>
I20260928 20:15:25.594363 1903 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:25.594444 1903 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:25.595813 1903 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.596589 1918 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.596836 1903 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:25.596933 1903 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "af968ec6e79a4467893791cb65764d80"
format_stamp: "Formatted at 2026-09-28 20:15:24 on dist-test-slave-n45k"
server_key: "33fceec20845802e897816bb5e98175a"
server_key_iv: "eee60cbcf03b03b213d1139dc6f56cfa"
server_key_version: "encryptionkey@0"
I20260928 20:15:25.597301 1903 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:25.619578 1903 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:25.621500 1903 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:25.621670 1903 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:25.621925 1903 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:25.622233 1903 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:25.622318 1903 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.622380 1903 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:25.622406 1903 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:25.628261 1903 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:37579
I20260928 20:15:25.628319 2031 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:37579 every 8 connection(s)
I20260928 20:15:25.628638 1903 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:25.632948 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 1903
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
W20260928 20:15:25.636372 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.629370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:38731 (local address 127.24.190.62:43865)
0928 20:15:25.629437 (+ 67us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.629439 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.629661 (+ 222us) server_negotiation.cc:407] Connection header received
0928 20:15:25.630179 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.630180 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.630192 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.630252 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.631224 (+ 972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.631726 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.632714 (+ 988us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.632926 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.633017 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.636326 (+ 3309us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:38731: BlockingRecv error: recv got EOF from 127.24.190.3:38731 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:15:25.636468 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.629360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:38731)
0928 20:15:25.629542 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.629577 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.630073 (+ 496us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.630348 (+ 275us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.630353 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.630931 (+ 578us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.631120 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.631125 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.631830 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.631831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.632620 (+ 789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.632622 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.633028 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.633029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.633174 (+ 145us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.633724 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.633732 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.636264 (+ 2532us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":89,"threads_started":1}
W20260928 20:15:25.636835 2032 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:43865 (0 consecutive failures): Not authorized: Failed to ping master at 127.24.190.62:43865: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.641106 2036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.633515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40802 (local address 127.24.190.62:43865)
0928 20:15:25.633717 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.633720 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.633727 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:15:25.633769 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.633770 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.633780 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.633863 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.634565 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.635129 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.636172 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.636444 (+ 272us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.636517 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.637946 (+ 1429us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:25.637950 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:25.637951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:25.637961 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:25.639676 (+ 1715us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:25.640052 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:25.640056 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:25.640056 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:25.640170 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:25.640383 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:25.640384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:25.640384 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:25.640612 (+ 228us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:25.640766 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:25.640876 (+ 110us) server_negotiation.cc:299] Negotiation successful
0928 20:15:25.640985 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":181,"thread_start_us":76,"threads_started":1}
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.641914 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.637083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:42455)
0928 20:15:25.637145 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.637155 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.637190 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.637334 (+ 144us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.637335 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.637444 (+ 109us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.637485 (+ 41us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.637486 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.638226 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.638227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.638999 (+ 772us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.639002 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.639443 (+ 441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.639444 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.639509 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.639953 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.639958 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.641850 (+ 1892us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":48}
W20260928 20:15:25.642027 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.637142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:42455 (local address 127.24.190.62:43865)
0928 20:15:25.637182 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.637185 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.637193 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:25.637254 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.637255 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.637264 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.637332 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.637554 (+ 222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.638175 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.639129 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.639353 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.639441 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.641956 (+ 2515us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:42455: BlockingRecv error: recv got EOF from 127.24.190.3:42455 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:25 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:25.646039 2034 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:25.642203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:49977)
0928 20:15:25.642236 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:25.642246 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:25.642330 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:25.642446 (+ 116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:25.642447 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:25.642570 (+ 123us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:25.642594 (+ 24us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.642595 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.643193 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.643194 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.643681 (+ 487us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:25.643683 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.644049 (+ 366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.644050 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:25.644102 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.644498 (+ 396us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:25.644502 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:25.645996 (+ 1494us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":18}
W20260928 20:15:25.646160 1769 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:25.642282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:49977 (local address 127.24.190.62:43865)
0928 20:15:25.642340 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:25.642342 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:25.642352 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:25.642378 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:25.642379 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:25.642388 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:25.642442 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:25.642668 (+ 226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.643115 (+ 447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.643787 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:25.643966 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:25.644048 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:25.646074 (+ 2026us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:49977: BlockingRecv error: recv got EOF from 127.24.190.3:49977 (error 108)
Metrics: {"server-negotiator.queue_time_us":38}
W20260928 20:15:25.646183 2032 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Sep 28 20:15:26 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:26 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:26.392590 2037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:26.388125 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:49509)
0928 20:15:26.388297 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:26.388307 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:26.388358 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:26.388541 (+ 183us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:26.388541 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:26.388694 (+ 153us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:26.388743 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:26.388745 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.389411 (+ 666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.389412 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:26.389953 (+ 541us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:26.389954 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.390334 (+ 380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.390338 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:26.390378 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:26.390793 (+ 415us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:26.390797 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:26.392499 (+ 1702us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":85,"threads_started":1}
W20260928 20:15:26.392726 2038 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:26.388203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:49509 (local address 127.24.190.62:43865)
0928 20:15:26.388342 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:26.388346 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:26.388362 (+ 16us) server_negotiation.cc:407] Connection header received
0928 20:15:26.388420 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:26.388421 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:26.388430 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:26.388531 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:26.388817 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.389334 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.390027 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.390212 (+ 185us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.390261 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:26.392618 (+ 2357us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:49509: BlockingRecv error: recv got EOF from 127.24.190.1:49509 (error 108)
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
Sep 28 20:15:26 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:26 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:26.518204 2039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:26.513191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:34763)
0928 20:15:26.513332 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:26.513344 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:26.513407 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:26.513515 (+ 108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:26.513515 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:26.513673 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:26.513722 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:26.513723 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.514489 (+ 766us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.514490 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:26.515028 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:26.515030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.515540 (+ 510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.515541 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:26.515594 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:26.516179 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:26.516184 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:26.518090 (+ 1906us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":62,"threads_started":1}
W20260928 20:15:26.518232 2038 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:26.513236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:34763 (local address 127.24.190.62:43865)
0928 20:15:26.513314 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:26.513316 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:26.513413 (+ 97us) server_negotiation.cc:407] Connection header received
0928 20:15:26.513444 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:26.513444 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:26.513456 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:26.513512 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:26.513785 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.514400 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.515148 (+ 748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.515441 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.515507 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:26.518168 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:34763: BlockingRecv error: recv got EOF from 127.24.190.2:34763 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 28 20:15:26 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:26 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:26.651209 2040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:26.646524 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:56861)
0928 20:15:26.646685 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:26.646697 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:26.646819 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:26.646976 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:26.646977 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:26.647159 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:26.647206 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:26.647208 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.647864 (+ 656us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.647865 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:26.648418 (+ 553us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:26.648421 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.648804 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.648805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:26.648861 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:26.649363 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:26.649367 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:26.651106 (+ 1739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":89,"threads_started":1}
W20260928 20:15:26.651250 2038 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:26.646596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:56861 (local address 127.24.190.62:43865)
0928 20:15:26.646672 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:26.646674 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:26.646798 (+ 124us) server_negotiation.cc:407] Connection header received
0928 20:15:26.646884 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:26.646885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:26.646899 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:26.646970 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:26.647288 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.647784 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.648529 (+ 745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:26.648717 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:26.648802 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:26.651179 (+ 2377us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:56861: BlockingRecv error: recv got EOF from 127.24.190.3:56861 (error 108)
Metrics: {"server-negotiator.queue_time_us":47}
Sep 28 20:15:27 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:27 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:27.398756 2041 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:27.393144 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:32985)
0928 20:15:27.393365 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:27.393378 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:27.393455 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:27.393650 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:27.393651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:27.393821 (+ 170us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:27.393880 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:27.393882 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.394718 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.394719 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:27.395257 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:27.395259 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.395658 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.395659 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:27.395726 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:27.396277 (+ 551us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:27.396281 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:27.398616 (+ 2335us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":70,"threads_started":1}
W20260928 20:15:27.398779 2042 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:27.393224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:32985 (local address 127.24.190.62:43865)
0928 20:15:27.393364 (+ 140us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:27.393366 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:27.393434 (+ 68us) server_negotiation.cc:407] Connection header received
0928 20:15:27.393513 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:27.393514 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:27.393530 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:27.393602 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:27.393970 (+ 368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.394623 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.395345 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.395544 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.395636 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:27.398708 (+ 3072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:32985: BlockingRecv error: recv got EOF from 127.24.190.1:32985 (error 108)
Metrics: {"server-negotiator.queue_time_us":116,"thread_start_us":81,"threads_started":1}
Sep 28 20:15:27 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:27 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:27.524060 2043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:27.518752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:39429)
0928 20:15:27.518888 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:27.518910 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:27.518978 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:27.519170 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:27.519171 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:27.519336 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:27.519386 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:27.519388 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.520069 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.520070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:27.520740 (+ 670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:27.520743 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.521182 (+ 439us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.521183 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:27.521235 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:27.521814 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:27.521827 (+ 13us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:27.524000 (+ 2173us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":86,"threads_started":1}
W20260928 20:15:27.524170 2042 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:27.518837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:39429 (local address 127.24.190.62:43865)
0928 20:15:27.518898 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:27.518900 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:27.518977 (+ 77us) server_negotiation.cc:407] Connection header received
0928 20:15:27.519032 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:27.519033 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:27.519043 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:27.519095 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:27.519454 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.519975 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.520837 (+ 862us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.521037 (+ 200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.521102 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:27.524123 (+ 3021us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:39429: BlockingRecv error: recv got EOF from 127.24.190.2:39429 (error 108)
Metrics: {"server-negotiator.queue_time_us":33}
Sep 28 20:15:27 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:27 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:27.656162 2044 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:27.651686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:53385)
0928 20:15:27.651849 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:27.651860 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:27.651915 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:27.652049 (+ 134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:27.652050 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:27.652209 (+ 159us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:27.652258 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:27.652260 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.652897 (+ 637us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.652897 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:27.653427 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:27.653429 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.653735 (+ 306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.653736 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:27.653781 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:27.654230 (+ 449us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:27.654235 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:27.656051 (+ 1816us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":70,"threads_started":1}
W20260928 20:15:27.656201 2042 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:27.651863 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:53385 (local address 127.24.190.62:43865)
0928 20:15:27.651929 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:27.651936 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:27.651945 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:27.651966 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:27.651967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:27.651978 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:27.652026 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:27.652343 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.652829 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.653501 (+ 672us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:27.653676 (+ 175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:27.653724 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:27.656134 (+ 2410us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:53385: BlockingRecv error: recv got EOF from 127.24.190.3:53385 (error 108)
Metrics: {"server-negotiator.queue_time_us":40}
Sep 28 20:15:28 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:28 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:28.404522 2045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:28.399228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:38427)
0928 20:15:28.399418 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:28.399430 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:28.399487 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:28.399648 (+ 161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:28.399649 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:28.399822 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:28.399871 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:28.399872 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.400746 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.400747 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:28.401298 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:28.401300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.401745 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.401745 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:28.401786 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:28.402395 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:28.402399 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:28.404446 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":123,"threads_started":1}
W20260928 20:15:28.404666 2046 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:28.399370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:38427 (local address 127.24.190.62:43865)
0928 20:15:28.399513 (+ 143us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:28.399515 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:28.399524 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:28.399556 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:28.399557 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:28.399567 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:28.399645 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:28.399938 (+ 293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.400672 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.401404 (+ 732us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.401675 (+ 271us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.401734 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:28.404541 (+ 2807us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:38427: BlockingRecv error: recv got EOF from 127.24.190.1:38427 (error 108)
Metrics: {"server-negotiator.queue_time_us":120,"thread_start_us":94,"threads_started":1}
Sep 28 20:15:28 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:28 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:28.530540 2047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:28.524745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:58911)
0928 20:15:28.524946 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:28.524958 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:28.525016 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:28.525256 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:28.525257 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:28.525422 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:28.525479 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:28.525480 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.526211 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.526212 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:28.526828 (+ 616us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:28.526837 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.527427 (+ 590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.527428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:28.527477 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:28.528034 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:28.528038 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:28.530416 (+ 2378us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":121,"threads_started":1}
W20260928 20:15:28.530591 2046 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:28.524844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:58911 (local address 127.24.190.62:43865)
0928 20:15:28.524927 (+ 83us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:28.524929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:28.525019 (+ 90us) server_negotiation.cc:407] Connection header received
0928 20:15:28.525082 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:28.525083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:28.525095 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:28.525140 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:28.525557 (+ 417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.526094 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.526976 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.527338 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.527416 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:28.530510 (+ 3094us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:58911: BlockingRecv error: recv got EOF from 127.24.190.2:58911 (error 108)
Metrics: {"server-negotiator.queue_time_us":55}
Sep 28 20:15:28 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:28 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:28.661968 2049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:28.656666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:51639)
0928 20:15:28.656852 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:28.656867 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:28.656962 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:28.657128 (+ 166us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:28.657129 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:28.657344 (+ 215us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:28.657391 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:28.657394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.658139 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.658141 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:28.658770 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:28.658772 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.659179 (+ 407us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.659180 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:28.659241 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:28.659734 (+ 493us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:28.659738 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:28.661905 (+ 2167us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":167,"thread_start_us":83,"threads_started":1}
W20260928 20:15:28.662114 2046 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:28.656774 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:51639 (local address 127.24.190.62:43865)
0928 20:15:28.656855 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:28.656857 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:28.656941 (+ 84us) server_negotiation.cc:407] Connection header received
0928 20:15:28.657024 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:28.657025 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:28.657040 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:28.657122 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:28.657481 (+ 359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.658044 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.658865 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:28.659082 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:28.659177 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:28.662025 (+ 2848us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:51639: BlockingRecv error: recv got EOF from 127.24.190.3:51639 (error 108)
Metrics: {"server-negotiator.queue_time_us":50}
Sep 28 20:15:29 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:29 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:29.410501 2050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:29.405189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:45769)
0928 20:15:29.405410 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:29.405421 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:29.405488 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:29.405759 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:29.405760 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:29.405924 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:29.405973 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:29.405975 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.406728 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.406729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:29.407271 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:29.407274 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.407761 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.407762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:29.407821 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:29.408320 (+ 499us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:29.408324 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:29.410443 (+ 2119us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":201,"thread_start_us":157,"threads_started":1}
W20260928 20:15:29.410670 2051 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:29.405308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:45769 (local address 127.24.190.62:43865)
0928 20:15:29.405428 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:29.405430 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:29.405551 (+ 121us) server_negotiation.cc:407] Connection header received
0928 20:15:29.405584 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:29.405585 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:29.405630 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:29.405708 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:29.406071 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.406606 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.407437 (+ 831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.407664 (+ 227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.407735 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:29.410556 (+ 2821us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:45769: BlockingRecv error: recv got EOF from 127.24.190.1:45769 (error 108)
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":57,"threads_started":1}
Sep 28 20:15:29 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:29 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:29.536084 2052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:29.531061 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:44045)
0928 20:15:29.531231 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:29.531244 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:29.531335 (+ 91us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:29.531504 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:29.531505 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:29.531684 (+ 179us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:29.531730 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:29.531732 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.532466 (+ 734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.532467 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:29.533014 (+ 547us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:29.533016 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.533406 (+ 390us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.533407 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:29.533479 (+ 72us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:29.533988 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:29.533992 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:29.535988 (+ 1996us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":92,"threads_started":1}
W20260928 20:15:29.536131 2051 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:29.531156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:44045 (local address 127.24.190.62:43865)
0928 20:15:29.531232 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:29.531235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:29.531317 (+ 82us) server_negotiation.cc:407] Connection header received
0928 20:15:29.531413 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:29.531414 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:29.531427 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:29.531498 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:29.531813 (+ 315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.532372 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.533113 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.533317 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.533404 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:29.536068 (+ 2664us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:44045: BlockingRecv error: recv got EOF from 127.24.190.2:44045 (error 108)
Metrics: {"server-negotiator.queue_time_us":48}
Sep 28 20:15:29 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:29 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:29.667510 2053 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:29.662577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:56483)
0928 20:15:29.662736 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:29.662749 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:29.662847 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:29.663019 (+ 172us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:29.663021 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:29.663204 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:29.663252 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:29.663253 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.663914 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.663915 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:29.664474 (+ 559us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:29.664476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.664939 (+ 463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.664941 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:29.664992 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:29.665509 (+ 517us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:29.665513 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:29.667444 (+ 1931us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":71,"threads_started":1}
W20260928 20:15:29.667685 2051 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:29.662615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:56483 (local address 127.24.190.62:43865)
0928 20:15:29.662669 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:29.662672 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:29.662852 (+ 180us) server_negotiation.cc:407] Connection header received
0928 20:15:29.662920 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:29.662921 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:29.662936 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:29.662992 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:29.663322 (+ 330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.663816 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.664559 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:29.664845 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:29.664904 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:29.667580 (+ 2676us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:56483: BlockingRecv error: recv got EOF from 127.24.190.3:56483 (error 108)
Metrics: {"server-negotiator.queue_time_us":25}
Sep 28 20:15:30 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:30 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:30.421659 2054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:30.411058 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:54403)
0928 20:15:30.411214 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:30.411224 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:30.411284 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:30.411412 (+ 128us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:30.411412 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:30.411567 (+ 155us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:30.411616 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:30.411617 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.412252 (+ 635us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.412253 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:30.412798 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:30.412799 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.413266 (+ 467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.413267 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:30.413309 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:30.419721 (+ 6412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:30.419727 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:30.421569 (+ 1842us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":92,"threads_started":1}
W20260928 20:15:30.421726 2055 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:30.411138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:54403 (local address 127.24.190.62:43865)
0928 20:15:30.411235 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:30.411238 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:30.411267 (+ 29us) server_negotiation.cc:407] Connection header received
0928 20:15:30.411330 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:30.411330 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:30.411341 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:30.411398 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:30.411680 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.412174 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.412880 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.413183 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.413265 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:30.421672 (+ 8407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:54403: BlockingRecv error: recv got EOF from 127.24.190.1:54403 (error 108)
Metrics: {"server-negotiator.queue_time_us":71,"thread_start_us":44,"threads_started":1}
Sep 28 20:15:30 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:30 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:30.545459 2056 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:30.536595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:50381)
0928 20:15:30.536737 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:30.536749 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:30.536804 (+ 55us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:30.536961 (+ 157us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:30.536962 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:30.537119 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:30.537172 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:30.537174 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.538014 (+ 840us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.538015 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:30.538628 (+ 613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:30.538630 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.538992 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.538993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:30.539035 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:30.543306 (+ 4271us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:30.543311 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:30.545358 (+ 2047us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":84,"threads_started":1}
W20260928 20:15:30.545509 2055 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:30.536725 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:50381 (local address 127.24.190.62:43865)
0928 20:15:30.536785 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:30.536787 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:30.536797 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:30.536853 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:30.536854 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:30.536863 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:30.536911 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:30.537317 (+ 406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.537921 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.538707 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.538921 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.538975 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:30.545447 (+ 6472us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:50381: BlockingRecv error: recv got EOF from 127.24.190.2:50381 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 28 20:15:30 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:30 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:30.672624 2057 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:30.667998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:34985)
0928 20:15:30.668194 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:30.668206 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:30.668300 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:30.668459 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:30.668460 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:30.668636 (+ 176us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:30.668679 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:30.668681 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.669382 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.669383 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:30.669920 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:30.669922 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.670321 (+ 399us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.670322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:30.670378 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:30.670822 (+ 444us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:30.670826 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:30.672530 (+ 1704us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":168,"thread_start_us":100,"threads_started":1}
W20260928 20:15:30.672674 2055 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:30.668100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:34985 (local address 127.24.190.62:43865)
0928 20:15:30.668192 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:30.668194 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:30.668281 (+ 87us) server_negotiation.cc:407] Connection header received
0928 20:15:30.668356 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:30.668357 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:30.668372 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:30.668442 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:30.668760 (+ 318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.669292 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.670009 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:30.670207 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:30.670328 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:30.672607 (+ 2279us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:34985: BlockingRecv error: recv got EOF from 127.24.190.3:34985 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 28 20:15:31 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:31 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:31.427047 2058 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:31.422300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:34815)
0928 20:15:31.422430 (+ 130us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:31.422444 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:31.422520 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:31.422694 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:31.422695 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:31.422866 (+ 171us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:31.422928 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:31.422930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.423736 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.423737 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:31.424287 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:31.424288 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.424655 (+ 367us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.424656 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:31.424731 (+ 75us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:31.425163 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:31.425167 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:31.426989 (+ 1822us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
W20260928 20:15:31.427165 2059 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:31.422409 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:34815 (local address 127.24.190.62:43865)
0928 20:15:31.422563 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:31.422564 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:31.422573 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:31.422599 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:31.422600 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:31.422613 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:31.422683 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:31.423007 (+ 324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.423619 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.424382 (+ 763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.424585 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.424646 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:31.427080 (+ 2434us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:34815: BlockingRecv error: recv got EOF from 127.24.190.1:34815 (error 108)
Metrics: {"server-negotiator.queue_time_us":133,"thread_start_us":68,"threads_started":1}
Sep 28 20:15:31 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:31 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:31.551118 2060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:31.545997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:33369)
0928 20:15:31.546133 (+ 136us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:31.546147 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:31.546329 (+ 182us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:31.546496 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:31.546497 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:31.546682 (+ 185us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:31.546737 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:31.546739 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.547416 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.547417 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:31.548094 (+ 677us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:31.548097 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.548550 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.548551 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:31.548620 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:31.549050 (+ 430us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:31.549055 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:31.551052 (+ 1997us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":98,"threads_started":1}
W20260928 20:15:31.551224 2059 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:31.546119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33369 (local address 127.24.190.62:43865)
0928 20:15:31.546200 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:31.546202 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:31.546297 (+ 95us) server_negotiation.cc:407] Connection header received
0928 20:15:31.546401 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:31.546402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:31.546415 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:31.546492 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:31.546824 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.547329 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.548190 (+ 861us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.548472 (+ 282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.548532 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:31.551145 (+ 2613us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:33369: BlockingRecv error: recv got EOF from 127.24.190.2:33369 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
Sep 28 20:15:31 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:31 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:31.678079 2061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:31.673304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:59337)
0928 20:15:31.673453 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:31.673464 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:31.673525 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:31.673650 (+ 125us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:31.673651 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:31.673819 (+ 168us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:31.673868 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:31.673870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.674522 (+ 652us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.674523 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:31.675071 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:31.675073 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.675445 (+ 372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.675446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:31.675484 (+ 38us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:31.675951 (+ 467us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:31.675956 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:31.677981 (+ 2025us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":91,"threads_started":1}
W20260928 20:15:31.678122 2059 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:31.673363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:59337 (local address 127.24.190.62:43865)
0928 20:15:31.673432 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:31.673434 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:31.673525 (+ 91us) server_negotiation.cc:407] Connection header received
0928 20:15:31.673569 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:31.673570 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:31.673581 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:31.673630 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:31.673928 (+ 298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.674451 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.675167 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:31.675375 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:31.675434 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:31.678060 (+ 2626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:59337: BlockingRecv error: recv got EOF from 127.24.190.3:59337 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 28 20:15:32 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:32 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:32.432907 2062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:32.427657 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:44655)
0928 20:15:32.427818 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:32.427831 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:32.427891 (+ 60us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:32.428055 (+ 164us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:32.428056 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:32.428229 (+ 173us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:32.428283 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:32.428285 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.429105 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.429106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:32.429735 (+ 629us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:32.429737 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.430105 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.430106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:32.430237 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:32.430787 (+ 550us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:32.430792 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:32.432813 (+ 2021us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":98,"threads_started":1}
W20260928 20:15:32.432992 2063 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:32.427765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:44655 (local address 127.24.190.62:43865)
0928 20:15:32.427913 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:32.427915 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:32.427924 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:32.427950 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:32.427951 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:32.427961 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:32.428037 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:32.428377 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.429040 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.429804 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.430007 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.430064 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:32.432919 (+ 2855us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:44655: BlockingRecv error: recv got EOF from 127.24.190.1:44655 (error 108)
Metrics: {"server-negotiator.queue_time_us":119,"thread_start_us":89,"threads_started":1}
Sep 28 20:15:32 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:32 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:32.556578 2064 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:32.551568 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:36961)
0928 20:15:32.551757 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:32.551767 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:32.551833 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:32.551959 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:32.551960 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:32.552120 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:32.552169 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:32.552171 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.552998 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.552999 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:32.553536 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:32.553538 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.553893 (+ 355us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.553893 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:32.553933 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:32.554602 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:32.554607 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:32.556518 (+ 1911us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":173,"thread_start_us":102,"threads_started":1}
W20260928 20:15:32.556771 2063 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:32.551642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:36961 (local address 127.24.190.62:43865)
0928 20:15:32.551695 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:32.551697 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:32.551850 (+ 153us) server_negotiation.cc:407] Connection header received
0928 20:15:32.551875 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:32.551876 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:32.551886 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:32.551941 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:32.552402 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.552915 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.553628 (+ 713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.553823 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.553880 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:32.556679 (+ 2799us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:36961: BlockingRecv error: recv got EOF from 127.24.190.2:36961 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
Sep 28 20:15:32 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:32 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:32.683700 2065 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:32.678565 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:40265)
0928 20:15:32.678762 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:32.678774 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:32.678868 (+ 94us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:32.679020 (+ 152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:32.679021 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:32.679320 (+ 299us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:32.679368 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:32.679370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.680054 (+ 684us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.680055 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:32.680601 (+ 546us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:32.680603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.681022 (+ 419us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.681023 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:32.681082 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:32.681616 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:32.681620 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:32.683605 (+ 1985us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
W20260928 20:15:32.683754 2063 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:32.678648 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:40265 (local address 127.24.190.62:43865)
0928 20:15:32.678746 (+ 98us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:32.678748 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:32.678849 (+ 101us) server_negotiation.cc:407] Connection header received
0928 20:15:32.678924 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:32.678925 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:32.678939 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:32.679014 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:32.679452 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.679961 (+ 509us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.680698 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:32.680889 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:32.681017 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:32.683689 (+ 2672us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:40265: BlockingRecv error: recv got EOF from 127.24.190.3:40265 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Sep 28 20:15:33 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:33 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:33.438912 2066 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:33.433679 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:42251)
0928 20:15:33.433844 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:33.433856 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:33.433909 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:33.434098 (+ 189us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:33.434099 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:33.434309 (+ 210us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:33.434360 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:33.434362 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.435073 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.435074 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:33.435843 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:33.435845 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.436291 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.436292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:33.436354 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:33.436888 (+ 534us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:33.436894 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:33.438807 (+ 1913us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":97,"threads_started":1}
W20260928 20:15:33.438956 2067 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:33.433825 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:42251 (local address 127.24.190.62:43865)
0928 20:15:33.433959 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:33.433961 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:33.433969 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:33.434001 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:33.434002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:33.434012 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:33.434075 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:33.434426 (+ 351us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.434986 (+ 560us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.435947 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.436158 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.436265 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:33.438884 (+ 2619us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:42251: BlockingRecv error: recv got EOF from 127.24.190.1:42251 (error 108)
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":77,"threads_started":1}
Sep 28 20:15:33 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:33 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:33.562220 2068 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:33.557057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:57415)
0928 20:15:33.557246 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:33.557258 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:33.557324 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:33.557611 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:33.557613 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:33.557793 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:33.557845 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:33.557847 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.558727 (+ 880us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.558729 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:33.559268 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:33.559270 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.559618 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.559619 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:33.559662 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:33.560304 (+ 642us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:33.560310 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:33.562129 (+ 1819us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":172,"thread_start_us":108,"threads_started":1}
W20260928 20:15:33.562350 2067 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:33.557153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:57415 (local address 127.24.190.62:43865)
0928 20:15:33.557243 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:33.557245 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:33.557324 (+ 79us) server_negotiation.cc:407] Connection header received
0928 20:15:33.557372 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:33.557373 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:33.557384 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:33.557508 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:33.557924 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.558629 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.559352 (+ 723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.559534 (+ 182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.559588 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:33.562249 (+ 2661us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:57415: BlockingRecv error: recv got EOF from 127.24.190.2:57415 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Sep 28 20:15:33 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:33 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:33.689338 2069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:33.684155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:39653)
0928 20:15:33.684374 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:33.684387 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:33.684492 (+ 105us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:33.684682 (+ 190us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:33.684683 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:33.684887 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:33.684935 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:33.684937 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.685728 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.685729 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:33.686337 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:33.686339 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.686764 (+ 425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.686765 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:33.686842 (+ 77us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:33.687288 (+ 446us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:33.687292 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:33.689233 (+ 1941us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":106,"threads_started":1}
W20260928 20:15:33.689383 2067 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:33.684273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:39653 (local address 127.24.190.62:43865)
0928 20:15:33.684367 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:33.684370 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:33.684470 (+ 100us) server_negotiation.cc:407] Connection header received
0928 20:15:33.684553 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:33.684554 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:33.684570 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:33.684676 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:33.685031 (+ 355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.685629 (+ 598us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.686454 (+ 825us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:33.686669 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:33.686761 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:33.689315 (+ 2554us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:39653: BlockingRecv error: recv got EOF from 127.24.190.3:39653 (error 108)
Metrics: {"server-negotiator.queue_time_us":60}
Sep 28 20:15:34 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:34 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:34.444361 2070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:34.439505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:46239)
0928 20:15:34.439651 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:34.439664 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:34.439729 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:34.439925 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:34.439927 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:34.440109 (+ 182us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:34.440159 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:34.440160 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.440813 (+ 653us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.440814 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:34.441414 (+ 600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:34.441417 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.441779 (+ 362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.441780 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:34.441824 (+ 44us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:34.442402 (+ 578us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:34.442407 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:34.444302 (+ 1895us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":89,"threads_started":1}
W20260928 20:15:34.444510 2071 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:34.439586 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:46239 (local address 127.24.190.62:43865)
0928 20:15:34.439759 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:34.439761 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:34.439771 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:34.439801 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:34.439801 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:34.439812 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:34.439877 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:34.440237 (+ 360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.440739 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.441497 (+ 758us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.441704 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.441760 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:34.444413 (+ 2653us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:46239: BlockingRecv error: recv got EOF from 127.24.190.1:46239 (error 108)
Metrics: {"server-negotiator.queue_time_us":153,"thread_start_us":119,"threads_started":1}
Sep 28 20:15:34 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:34 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:34.567957 2072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:34.562894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:59415)
0928 20:15:34.563093 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:34.563106 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:34.563182 (+ 76us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:34.563347 (+ 165us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:34.563348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:34.563540 (+ 192us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:34.563585 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:34.563587 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.564357 (+ 770us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.564358 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:34.564890 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:34.564891 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.565256 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.565257 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:34.565313 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:34.565822 (+ 509us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:34.565827 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:34.567860 (+ 2033us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":180,"thread_start_us":97,"threads_started":1}
W20260928 20:15:34.568008 2071 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:34.562999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:59415 (local address 127.24.190.62:43865)
0928 20:15:34.563078 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:34.563081 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:34.563181 (+ 100us) server_negotiation.cc:407] Connection header received
0928 20:15:34.563255 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:34.563256 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:34.563276 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:34.563342 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:34.563668 (+ 326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.564259 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.564977 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.565175 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.565259 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:34.567941 (+ 2682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:59415: BlockingRecv error: recv got EOF from 127.24.190.2:59415 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 28 20:15:34 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:34 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:34.695873 2074 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:34.689864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:33441)
0928 20:15:34.690016 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:34.690035 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:34.690094 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:34.690296 (+ 202us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:34.690297 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:34.690460 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:34.690509 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:34.690511 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.691187 (+ 676us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.691188 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:34.692072 (+ 884us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:34.692075 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.692635 (+ 560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.692636 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:34.692699 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:34.693333 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:34.693340 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:34.695783 (+ 2443us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":134,"thread_start_us":105,"threads_started":1}
W20260928 20:15:34.695981 2071 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:34.689945 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:33441 (local address 127.24.190.62:43865)
0928 20:15:34.689997 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:34.689999 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:34.690096 (+ 97us) server_negotiation.cc:407] Connection header received
0928 20:15:34.690160 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:34.690160 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:34.690174 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:34.690231 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:34.690585 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.691090 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.692177 (+ 1087us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:34.692534 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:34.692611 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:34.695904 (+ 3293us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:33441: BlockingRecv error: recv got EOF from 127.24.190.3:33441 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
Sep 28 20:15:35 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:35 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:35.454708 2075 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:35.444945 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:42989)
0928 20:15:35.445125 (+ 180us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:35.445138 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:35.445218 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:35.445347 (+ 129us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:35.445348 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:35.445508 (+ 160us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:35.445558 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:35.445559 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.446387 (+ 828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.446388 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:35.446951 (+ 563us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:35.446953 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.447398 (+ 445us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.447399 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:35.447446 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:35.452265 (+ 4819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:35.452271 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:35.454647 (+ 2376us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":108,"threads_started":1}
W20260928 20:15:35.454880 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:35.445031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:42989 (local address 127.24.190.62:43865)
0928 20:15:35.445156 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:35.445158 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:35.445221 (+ 63us) server_negotiation.cc:407] Connection header received
0928 20:15:35.445269 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:35.445270 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:35.445280 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:35.445336 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:35.445655 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.446247 (+ 592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.447044 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.447317 (+ 273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.447380 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:35.454796 (+ 7416us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:42989: BlockingRecv error: recv got EOF from 127.24.190.1:42989 (error 108)
Metrics: {"server-negotiator.queue_time_us":101,"thread_start_us":50,"threads_started":1}
Sep 28 20:15:35 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:35 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:35.573858 2077 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:35.568561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:52401)
0928 20:15:35.568738 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:35.568755 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:35.568823 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:35.568986 (+ 163us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:35.568987 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:35.569243 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:35.569295 (+ 52us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:35.569297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.570071 (+ 774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.570073 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:35.570830 (+ 757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:35.570833 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.571226 (+ 393us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.571227 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:35.571270 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:35.571782 (+ 512us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:35.571788 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:35.573791 (+ 2003us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":74,"threads_started":1}
W20260928 20:15:35.574018 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:35.568684 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:52401 (local address 127.24.190.62:43865)
0928 20:15:35.568758 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:35.568760 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:35.568821 (+ 61us) server_negotiation.cc:407] Connection header received
0928 20:15:35.568884 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:35.568885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:35.568895 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:35.568935 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:35.569411 (+ 476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.569935 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.570922 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.571150 (+ 228us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.571222 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:35.573934 (+ 2712us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:52401: BlockingRecv error: recv got EOF from 127.24.190.2:52401 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 28 20:15:35 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:35 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:35.701268 2078 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:35.696334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:48723)
0928 20:15:35.696501 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:35.696520 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:35.696585 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:35.696731 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:35.696732 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:35.696895 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:35.696943 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:35.696944 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.697659 (+ 715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.697659 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:35.698207 (+ 548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:35.698209 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.698611 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.698612 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:35.698694 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:35.699146 (+ 452us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:35.699152 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:35.701181 (+ 2029us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":143,"thread_start_us":60,"threads_started":1}
W20260928 20:15:35.701350 2076 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:35.696519 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48723 (local address 127.24.190.62:43865)
0928 20:15:35.696589 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:35.696591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:35.696616 (+ 25us) server_negotiation.cc:407] Connection header received
0928 20:15:35.696638 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:35.696638 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:35.696650 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:35.696719 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:35.697011 (+ 292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.697550 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.698339 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:35.698519 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:35.698573 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:35.701272 (+ 2699us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:48723: BlockingRecv error: recv got EOF from 127.24.190.3:48723 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
Sep 28 20:15:36 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:36 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:36.460321 2079 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:36.455209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:37977)
0928 20:15:36.455355 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:36.455374 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:36.455426 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:36.455573 (+ 147us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:36.455573 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:36.455785 (+ 212us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:36.455836 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:36.455838 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.456519 (+ 681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.456520 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:36.457126 (+ 606us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:36.457128 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.457512 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.457513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:36.457562 (+ 49us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:36.458037 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:36.458042 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:36.460187 (+ 2145us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":95,"threads_started":1}
W20260928 20:15:36.460440 2080 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:36.455286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:37977 (local address 127.24.190.62:43865)
0928 20:15:36.455409 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:36.455411 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:36.455421 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:36.455493 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:36.455494 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:36.455503 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:36.455553 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:36.455909 (+ 356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.456446 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.457243 (+ 797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.457439 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.457492 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:36.460360 (+ 2868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:37977: BlockingRecv error: recv got EOF from 127.24.190.1:37977 (error 108)
Metrics: {"server-negotiator.queue_time_us":103,"thread_start_us":73,"threads_started":1}
Sep 28 20:15:36 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:36 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:36.579542 2081 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:36.574395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:46653)
0928 20:15:36.574562 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:36.574574 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:36.574644 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:36.574792 (+ 148us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:36.574793 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:36.574973 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:36.575028 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:36.575030 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.575768 (+ 738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.575769 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:36.576459 (+ 690us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:36.576461 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.576844 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.576845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:36.576895 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:36.577379 (+ 484us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:36.577384 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:36.579421 (+ 2037us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":117,"threads_started":1}
W20260928 20:15:36.579572 2080 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:36.574500 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:46653 (local address 127.24.190.62:43865)
0928 20:15:36.574565 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:36.574570 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:36.574643 (+ 73us) server_negotiation.cc:407] Connection header received
0928 20:15:36.574702 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:36.574703 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:36.574714 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:36.574771 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:36.575099 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.575663 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.576546 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.576764 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.576823 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:36.579502 (+ 2679us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:46653: BlockingRecv error: recv got EOF from 127.24.190.2:46653 (error 108)
Metrics: {"server-negotiator.queue_time_us":37}
Sep 28 20:15:36 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:36 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:36.707373 2082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:36.701732 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:57073)
0928 20:15:36.702076 (+ 344us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:36.702107 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:36.702178 (+ 71us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:36.702336 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:36.702338 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:36.702585 (+ 247us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:36.702657 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:36.702659 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.703477 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.703479 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:36.704082 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:36.704165 (+ 83us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.704603 (+ 438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.704604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:36.704666 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:36.705204 (+ 538us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:36.705208 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:36.707300 (+ 2092us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":315,"thread_start_us":236,"threads_started":1}
W20260928 20:15:36.707510 2080 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:36.701971 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:57073 (local address 127.24.190.62:43865)
0928 20:15:36.702029 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:36.702031 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:36.702185 (+ 154us) server_negotiation.cc:407] Connection header received
0928 20:15:36.702222 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:36.702222 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:36.702235 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:36.702314 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:36.702755 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.703388 (+ 633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.704263 (+ 875us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:36.704506 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:36.704608 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:36.707427 (+ 2819us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:57073: BlockingRecv error: recv got EOF from 127.24.190.3:57073 (error 108)
Metrics: {"server-negotiator.queue_time_us":29}
Sep 28 20:15:37 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:37 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:37.466099 2083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:37.461005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:52637)
0928 20:15:37.461228 (+ 223us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:37.461239 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:37.461301 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:37.461443 (+ 142us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:37.461444 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:37.461611 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:37.461667 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:37.461669 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.462472 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.462473 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:37.463064 (+ 591us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:37.463066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.463598 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.463599 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:37.463640 (+ 41us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:37.464144 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:37.464149 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:37.466040 (+ 1891us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":202,"thread_start_us":139,"threads_started":1}
W20260928 20:15:37.466346 2084 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:37.461137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:52637 (local address 127.24.190.62:43865)
0928 20:15:37.461247 (+ 110us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:37.461249 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:37.461307 (+ 58us) server_negotiation.cc:407] Connection header received
0928 20:15:37.461348 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:37.461348 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:37.461360 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:37.461424 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:37.461738 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.462392 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.463329 (+ 937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.463524 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.463588 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:37.466223 (+ 2635us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:52637: BlockingRecv error: recv got EOF from 127.24.190.1:52637 (error 108)
Metrics: {"server-negotiator.queue_time_us":82,"thread_start_us":50,"threads_started":1}
Sep 28 20:15:37 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:37 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:37.584951 2085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:37.580219 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:35905)
0928 20:15:37.580377 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:37.580393 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:37.580452 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:37.580587 (+ 135us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:37.580588 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:37.580765 (+ 177us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:37.580816 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:37.580818 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.581450 (+ 632us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.581451 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:37.582031 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:37.582033 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.582485 (+ 452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.582486 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:37.582537 (+ 51us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:37.582954 (+ 417us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:37.582959 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:37.584888 (+ 1929us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":100,"threads_started":1}
W20260928 20:15:37.585059 2084 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:37.580310 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:35905 (local address 127.24.190.62:43865)
0928 20:15:37.580381 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:37.580382 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:37.580451 (+ 69us) server_negotiation.cc:407] Connection header received
0928 20:15:37.580500 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:37.580501 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:37.580511 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:37.580561 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:37.580880 (+ 319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.581371 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.582107 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.582415 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.582470 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:37.584986 (+ 2516us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:35905: BlockingRecv error: recv got EOF from 127.24.190.2:35905 (error 108)
Metrics: {"server-negotiator.queue_time_us":41}
Sep 28 20:15:37 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:37 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:37.712925 2086 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:37.707921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:54123)
0928 20:15:37.708072 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:37.708082 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:37.708146 (+ 64us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:37.708282 (+ 136us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:37.708283 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:37.708448 (+ 165us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:37.708493 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:37.708495 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.709586 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.709587 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:37.710109 (+ 522us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:37.710117 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.710492 (+ 375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.710493 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:37.710535 (+ 42us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:37.711058 (+ 523us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:37.711062 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:37.712868 (+ 1806us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":124,"thread_start_us":92,"threads_started":1}
W20260928 20:15:37.713052 2084 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:37.707995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:54123 (local address 127.24.190.62:43865)
0928 20:15:37.708071 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:37.708073 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:37.708150 (+ 77us) server_negotiation.cc:407] Connection header received
0928 20:15:37.708192 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:37.708193 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:37.708205 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:37.708263 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:37.708644 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.709518 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.710187 (+ 669us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:37.710430 (+ 243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:37.710485 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:37.712964 (+ 2479us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:54123: BlockingRecv error: recv got EOF from 127.24.190.3:54123 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
Sep 28 20:15:38 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:38 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:38.471689 2087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:38.466607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:44935)
0928 20:15:38.466827 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:38.466841 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:38.466918 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:38.467086 (+ 168us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:38.467087 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:38.467267 (+ 180us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:38.467317 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:38.467319 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.467996 (+ 677us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.467998 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:38.468642 (+ 644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:38.468644 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.469094 (+ 450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.469094 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:38.469144 (+ 50us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:38.469664 (+ 520us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:38.469669 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:38.471631 (+ 1962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":171,"thread_start_us":130,"threads_started":1}
W20260928 20:15:38.471799 2088 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:38.466691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:44935 (local address 127.24.190.62:43865)
0928 20:15:38.466816 (+ 125us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:38.466818 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:38.466903 (+ 85us) server_negotiation.cc:407] Connection header received
0928 20:15:38.466977 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:38.466978 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:38.466991 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:38.467040 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:38.467394 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.467920 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.468728 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.469012 (+ 284us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.469082 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:38.471722 (+ 2640us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:44935: BlockingRecv error: recv got EOF from 127.24.190.1:44935 (error 108)
Metrics: {"server-negotiator.queue_time_us":99,"thread_start_us":56,"threads_started":1}
Sep 28 20:15:38 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:38 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:38.591040 2089 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:38.585533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:57021)
0928 20:15:38.585691 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:38.585705 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:38.585782 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:38.585974 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:38.585975 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:38.586214 (+ 239us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:38.586344 (+ 130us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:38.586346 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.587330 (+ 984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.587331 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:38.587868 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:38.587870 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.588291 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.588292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:38.588331 (+ 39us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:38.588934 (+ 603us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:38.588939 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:38.590966 (+ 2027us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":75,"threads_started":1}
W20260928 20:15:38.591145 2088 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:38.585682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:57021 (local address 127.24.190.62:43865)
0928 20:15:38.585728 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:38.585733 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:38.585770 (+ 37us) server_negotiation.cc:407] Connection header received
0928 20:15:38.585852 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:38.585854 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:38.585868 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:38.585939 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:38.586443 (+ 504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.587255 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.587963 (+ 708us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.588192 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.588260 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:38.591076 (+ 2816us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:57021: BlockingRecv error: recv got EOF from 127.24.190.2:57021 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
Sep 28 20:15:38 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:38 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:38.718647 2090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:38.713469 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:47759)
0928 20:15:38.713677 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:38.713692 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:38.713807 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:38.714003 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:38.714003 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:38.714235 (+ 232us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:38.714343 (+ 108us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:38.714346 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.715039 (+ 693us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.715040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:38.715601 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:38.715603 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.715971 (+ 368us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.715972 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:38.716028 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:38.716543 (+ 515us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:38.716548 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:38.718572 (+ 2024us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":186,"thread_start_us":101,"threads_started":1}
W20260928 20:15:38.718814 2088 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:38.713556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:47759 (local address 127.24.190.62:43865)
0928 20:15:38.713690 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:38.713692 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:38.713780 (+ 88us) server_negotiation.cc:407] Connection header received
0928 20:15:38.713903 (+ 123us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:38.713904 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:38.713919 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:38.713997 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:38.714434 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.714954 (+ 520us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.715698 (+ 744us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:38.715896 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:38.715973 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:38.718730 (+ 2757us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:47759: BlockingRecv error: recv got EOF from 127.24.190.3:47759 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
Sep 28 20:15:39 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:39 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:39.477393 2091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:39.472263 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:34107)
0928 20:15:39.472449 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:39.472460 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:39.472546 (+ 86us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:39.472742 (+ 196us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:39.472743 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:39.472927 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:39.472978 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:39.472980 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.473686 (+ 706us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.473687 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:39.474376 (+ 689us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:39.474379 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.474744 (+ 365us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.474745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:39.474790 (+ 45us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:39.475322 (+ 532us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:39.475327 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:39.477284 (+ 1957us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":100,"threads_started":1}
W20260928 20:15:39.477438 2092 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:39.472371 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:34107 (local address 127.24.190.62:43865)
0928 20:15:39.472593 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:39.472600 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:39.472608 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:39.472632 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:39.472632 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:39.472643 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:39.472714 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:39.473085 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.473589 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.474449 (+ 860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.474669 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.474726 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:39.477365 (+ 2639us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:34107: BlockingRecv error: recv got EOF from 127.24.190.1:34107 (error 108)
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":153,"threads_started":1}
Sep 28 20:15:39 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:39 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:39.596699 2093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:39.591653 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:40155)
0928 20:15:39.591840 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:39.591854 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:39.591949 (+ 95us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:39.592133 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:39.592134 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:39.592321 (+ 187us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:39.592368 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:39.592370 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.593363 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.593365 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:39.593897 (+ 532us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:39.593899 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.594311 (+ 412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.594312 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:39.594380 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:39.594825 (+ 445us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:39.594829 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:39.596641 (+ 1812us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":102,"threads_started":1}
W20260928 20:15:39.596880 2092 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:39.591757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:40155 (local address 127.24.190.62:43865)
0928 20:15:39.591843 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:39.591845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:39.591929 (+ 84us) server_negotiation.cc:407] Connection header received
0928 20:15:39.592041 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:39.592042 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:39.592054 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:39.592128 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:39.592453 (+ 325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.593283 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.593986 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.594209 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.594309 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:39.596793 (+ 2484us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:40155: BlockingRecv error: recv got EOF from 127.24.190.2:40155 (error 108)
Metrics: {"server-negotiator.queue_time_us":56}
Sep 28 20:15:39 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:39 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.3@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:39.724000 2094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:39.719131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.3:47521)
0928 20:15:39.719263 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:39.719282 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:39.719340 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:39.719575 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:39.719575 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:39.719774 (+ 199us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:39.719819 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:39.719820 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.720522 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.720522 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:39.721072 (+ 550us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:39.721074 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.721427 (+ 353us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.721428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:39.721471 (+ 43us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:39.721913 (+ 442us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:39.721918 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:39.723940 (+ 2022us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":57,"threads_started":1}
W20260928 20:15:39.724112 2092 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:39.719295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:47521 (local address 127.24.190.62:43865)
0928 20:15:39.719456 (+ 161us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:39.719458 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:39.719474 (+ 16us) server_negotiation.cc:407] Connection header received
0928 20:15:39.719498 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:39.719499 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:39.719508 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:39.719556 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:39.719893 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.720445 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.721149 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:39.721358 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:39.721413 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:39.724028 (+ 2615us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.3:47521: BlockingRecv error: recv got EOF from 127.24.190.3:47521 (error 108)
Metrics: {"server-negotiator.queue_time_us":135}
Sep 28 20:15:40 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:40 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.1@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:40.488631 2095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:40.478060 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.1:48651)
0928 20:15:40.478259 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:40.478272 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:40.478352 (+ 80us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:40.478557 (+ 205us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:40.478558 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:40.478789 (+ 231us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:40.478839 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:40.478842 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.479835 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.479836 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:40.480482 (+ 646us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:40.480485 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.480905 (+ 420us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.480907 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:40.480981 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:40.486698 (+ 5717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:40.486704 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:40.488571 (+ 1867us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":162,"thread_start_us":75,"threads_started":1}
W20260928 20:15:40.488732 2096 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:40.478128 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:48651 (local address 127.24.190.62:43865)
0928 20:15:40.478322 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:40.478324 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:40.478334 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:15:40.478463 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:40.478464 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:40.478477 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:40.478545 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:40.478983 (+ 438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.479738 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.480570 (+ 832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.480787 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.480866 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:40.488676 (+ 7810us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.1:48651: BlockingRecv error: recv got EOF from 127.24.190.1:48651 (error 108)
Metrics: {"server-negotiator.queue_time_us":170,"thread_start_us":161,"threads_started":1}
Sep 28 20:15:40 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
Sep 28 20:15:40 dist-test-slave-n45k krb5kdc[1029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.24.190.2@KRBTEST.COM for oryx/127.24.190.62@KRBTEST.COM, Server not found in Kerberos database
I20260928 20:15:40.603080 2097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:40.597305 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43865 (local address 127.24.190.2:39899)
0928 20:15:40.597533 (+ 228us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:40.597547 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:40.597643 (+ 96us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:40.597822 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:40.597823 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:40.598012 (+ 189us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:40.598061 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:40.598063 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.599081 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.599082 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:40.599859 (+ 777us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:40.599862 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.600424 (+ 562us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.600425 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:40.600465 (+ 40us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:40.600943 (+ 478us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:40.600948 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:40.602982 (+ 2034us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.24.190.62:43865: Server oryx/127.24.190.62@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":204,"thread_start_us":89,"threads_started":1}
W20260928 20:15:40.603132 2096 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:40.597443 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:39899 (local address 127.24.190.62:43865)
0928 20:15:40.597547 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:40.597549 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:40.597635 (+ 86us) server_negotiation.cc:407] Connection header received
0928 20:15:40.597719 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:40.597720 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:40.597731 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:40.597815 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:40.598226 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.599004 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.599948 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.600341 (+ 393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.600406 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:40.603069 (+ 2663us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.24.190.2:39899: BlockingRecv error: recv got EOF from 127.24.190.2:39899 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260928 20:15:40.642514 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1616
I20260928 20:15:40.647533 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1770
I20260928 20:15:40.651741 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1903
I20260928 20:15:40.655869 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 1545
2026-09-28T20:15:40Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (17500 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-09-28T20:15:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:40Z Disabled control of system clock
I20260928 20:15:40.684371 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39121
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:39121
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260928 20:15:40.766139 2101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:40.766376 2101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:40.766398 2101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:40.767650 2101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:40.767697 2101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:40.767710 2101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:40.767724 2101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:40.767740 2101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:40.769215 2101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:39121
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2101
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:40.769501 2101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:40.769824 2101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:15:40.775667 2101 server_base.cc:1034] running on GCE node
W20260928 20:15:40.775615 2109 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:40.775655 2106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:40.775584 2107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:40.776221 2101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:40.776536 2101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:40.777711 2101 hybrid_clock.cc:648] HybridClock initialized: now 1790626540777692 us; error 41 us; skew 500 ppm
I20260928 20:15:40.779187 2101 webserver.cc:460] Webserver started at http://127.24.190.62:44959/ using document root <none> and password file <none>
I20260928 20:15:40.779474 2101 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:40.779547 2101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:40.779695 2101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:40.780807 2101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "085ae0d0582d4a0d830562fbd14b357b"
format_stamp: "Formatted at 2026-09-28 20:15:40 on dist-test-slave-n45k"
server_key: "048b4491ae749ebdabb9ad0cd13ca37a"
server_key_iv: "0354d1b0a002e2de93c3df1add530474"
server_key_version: "encryptionkey@0"
I20260928 20:15:40.781174 2101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "085ae0d0582d4a0d830562fbd14b357b"
format_stamp: "Formatted at 2026-09-28 20:15:40 on dist-test-slave-n45k"
server_key: "048b4491ae749ebdabb9ad0cd13ca37a"
server_key_iv: "0354d1b0a002e2de93c3df1add530474"
server_key_version: "encryptionkey@0"
I20260928 20:15:40.782552 2101 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:40.783463 2115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:40.783706 2101 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:40.783849 2101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "085ae0d0582d4a0d830562fbd14b357b"
format_stamp: "Formatted at 2026-09-28 20:15:40 on dist-test-slave-n45k"
server_key: "048b4491ae749ebdabb9ad0cd13ca37a"
server_key_iv: "0354d1b0a002e2de93c3df1add530474"
server_key_version: "encryptionkey@0"
I20260928 20:15:40.783931 2101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:40.818126 2101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:40.818531 2101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:40.818701 2101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:40.822904 2101 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:39121
I20260928 20:15:40.822942 2168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:39121 every 8 connection(s)
I20260928 20:15:40.823349 2101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:40.824033 2169 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:40.826983 2169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b: Bootstrap starting.
I20260928 20:15:40.827793 2169 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:40.828140 2169 log.cc:824] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:40.829217 2169 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b: No bootstrap required, opened a new log
I20260928 20:15:40.829182 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2101
I20260928 20:15:40.829334 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:40.829535 25336 external_mini_cluster.cc:1428] Setting key 2ea16ebb845eb49781938726fb168950
I20260928 20:15:40.832434 2169 raft_consensus.cc:348] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085ae0d0582d4a0d830562fbd14b357b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39121 } }
I20260928 20:15:40.832836 2169 raft_consensus.cc:374] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:40.832887 2169 raft_consensus.cc:729] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 085ae0d0582d4a0d830562fbd14b357b, State: Initialized, Role: FOLLOWER
I20260928 20:15:40.833009 2169 consensus_queue.cc:260] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085ae0d0582d4a0d830562fbd14b357b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39121 } }
I20260928 20:15:40.833079 2169 raft_consensus.cc:388] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:40.833112 2169 raft_consensus.cc:482] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:40.833158 2169 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:40.834139 2169 raft_consensus.cc:504] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085ae0d0582d4a0d830562fbd14b357b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39121 } }
I20260928 20:15:40.834250 2169 leader_election.cc:302] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 085ae0d0582d4a0d830562fbd14b357b; no voters:
I20260928 20:15:40.834425 2169 leader_election.cc:288] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:40.834488 2174 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:40.834683 2169 sys_catalog.cc:564] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:40.834692 2174 raft_consensus.cc:686] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [term 1 LEADER]: Becoming Leader. State: Replica: 085ae0d0582d4a0d830562fbd14b357b, State: Running, Role: LEADER
I20260928 20:15:40.834878 2174 consensus_queue.cc:237] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085ae0d0582d4a0d830562fbd14b357b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39121 } }
I20260928 20:15:40.835289 2174 sys_catalog.cc:455] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 085ae0d0582d4a0d830562fbd14b357b. Latest consensus state: current_term: 1 leader_uuid: "085ae0d0582d4a0d830562fbd14b357b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085ae0d0582d4a0d830562fbd14b357b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39121 } } }
I20260928 20:15:40.835439 2174 sys_catalog.cc:458] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:40.835297 2175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "085ae0d0582d4a0d830562fbd14b357b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "085ae0d0582d4a0d830562fbd14b357b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39121 } } }
I20260928 20:15:40.835666 2175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:40.836050 2182 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:40.836565 2182 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:40.839143 2182 catalog_manager.cc:1347] Generated new cluster ID: 15ed280a0dee44fc9ccd3940bd7d61b0
I20260928 20:15:40.839200 2182 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:40.840293 2173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:40.830400 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51282 (local address 127.24.190.62:39121)
0928 20:15:40.830612 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:40.830623 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:40.830659 (+ 36us) server_negotiation.cc:407] Connection header received
0928 20:15:40.832394 (+ 1735us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:40.832403 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:40.832573 (+ 170us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:40.832788 (+ 215us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:40.833326 (+ 538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.836061 (+ 2735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.837333 (+ 1272us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:40.838307 (+ 974us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:40.839027 (+ 720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:40.839358 (+ 331us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:40.839362 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:40.839362 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:40.839788 (+ 426us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:40.839828 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:40.839844 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:40.839915 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:40.839999 (+ 84us) server_negotiation.cc:299] Negotiation successful
0928 20:15:40.840097 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":78,"threads_started":1}
I20260928 20:15:40.859642 2182 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:40.860387 2182 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:40.863762 2182 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 085ae0d0582d4a0d830562fbd14b357b: Generated new TSK 0
I20260928 20:15:40.863955 2182 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:15:40.874743 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39121
--builtin_ntp_servers=127.24.190.20:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260928 20:15:40.974107 2193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:40.974400 2193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:40.974440 2193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:40.975740 2193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:40.975808 2193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:40.975852 2193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:40.977226 2193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2193
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:40.977506 2193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:40.977914 2193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:40.983270 2199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:40.983445 2198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:40.983280 2201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:40.983685 2193 server_base.cc:1034] running on GCE node
I20260928 20:15:40.983946 2193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:40.984203 2193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:40.985380 2193 hybrid_clock.cc:648] HybridClock initialized: now 1790626540985366 us; error 30 us; skew 500 ppm
I20260928 20:15:40.986821 2193 webserver.cc:460] Webserver started at http://127.24.190.1:39347/ using document root <none> and password file <none>
I20260928 20:15:40.987064 2193 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:40.987130 2193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:40.987268 2193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:40.988474 2193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "7eea133f252449d4a819bb3d5427bbb8"
format_stamp: "Formatted at 2026-09-28 20:15:40 on dist-test-slave-n45k"
server_key: "5ec784950451178b876df8eaae187751"
server_key_iv: "2f79918872d70946cdbbf7b95a5d1359"
server_key_version: "encryptionkey@0"
I20260928 20:15:40.988838 2193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "7eea133f252449d4a819bb3d5427bbb8"
format_stamp: "Formatted at 2026-09-28 20:15:40 on dist-test-slave-n45k"
server_key: "5ec784950451178b876df8eaae187751"
server_key_iv: "2f79918872d70946cdbbf7b95a5d1359"
server_key_version: "encryptionkey@0"
I20260928 20:15:40.990190 2193 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260928 20:15:40.991029 2207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:40.991206 2193 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:40.991304 2193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "7eea133f252449d4a819bb3d5427bbb8"
format_stamp: "Formatted at 2026-09-28 20:15:40 on dist-test-slave-n45k"
server_key: "5ec784950451178b876df8eaae187751"
server_key_iv: "2f79918872d70946cdbbf7b95a5d1359"
server_key_version: "encryptionkey@0"
I20260928 20:15:40.991395 2193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.015792 2193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.016141 2193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.016347 2193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.016607 2193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:41.016968 2193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:41.017026 2193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.017062 2193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:41.017107 2193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.022835 2193 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:43683
I20260928 20:15:41.022943 2321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:43683 every 8 connection(s)
I20260928 20:15:41.023252 2193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:41.028383 2173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.024038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:55147 (local address 127.24.190.62:39121)
0928 20:15:41.024113 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.024115 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.024385 (+ 270us) server_negotiation.cc:407] Connection header received
0928 20:15:41.024874 (+ 489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.024875 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.024887 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.024944 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.025577 (+ 633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.026072 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.027051 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.027235 (+ 184us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.027306 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:41.028149 (+ 843us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.028150 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.028150 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.028154 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.028164 (+ 10us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.028167 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.028206 (+ 39us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.028279 (+ 73us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.028324 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260928 20:15:41.028549 2324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.024021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39121 (local address 127.24.190.1:55147)
0928 20:15:41.024255 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:41.024302 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:41.024792 (+ 490us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:41.025006 (+ 214us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:41.025009 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:41.025018 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:41.025506 (+ 488us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:41.025510 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.026158 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.026159 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:41.026976 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:41.026979 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.027315 (+ 336us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.027316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:41.027429 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:41.028028 (+ 599us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:41.028028 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:41.028057 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:41.028080 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:41.028218 (+ 138us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:41.028220 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:41.028223 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:41.028272 (+ 49us) client_negotiation.cc:240] Negotiation successful
0928 20:15:41.028352 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":85,"threads_started":1}
I20260928 20:15:41.029052 2322 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39121
I20260928 20:15:41.029142 2322 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:41.029341 2322 heartbeater.cc:511] Master 127.24.190.62:39121 requested a full tablet report, sending...
I20260928 20:15:41.029881 2132 ts_manager.cc:194] Registered new tserver with Master: 7eea133f252449d4a819bb3d5427bbb8 (127.24.190.1:43683)
I20260928 20:15:41.030467 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2193
I20260928 20:15:41.030565 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:41.030814 25336 external_mini_cluster.cc:1428] Setting key 74edaebf2e7b3da1ad47d2c084325d7b
I20260928 20:15:41.030804 2132 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.1:55147
I20260928 20:15:41.031839 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39121
--builtin_ntp_servers=127.24.190.20:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260928 20:15:41.115320 2325 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:41.115561 2325 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:41.115597 2325 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:41.116775 2325 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:41.116839 2325 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:41.116885 2325 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:41.118364 2325 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2325
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:41.118633 2325 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:41.118940 2325 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:41.124228 2330 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.124343 2331 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.124297 2333 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.124563 2325 server_base.cc:1034] running on GCE node
I20260928 20:15:41.124845 2325 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:41.125098 2325 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:41.126310 2325 hybrid_clock.cc:648] HybridClock initialized: now 1790626541126249 us; error 33 us; skew 500 ppm
I20260928 20:15:41.127583 2325 webserver.cc:460] Webserver started at http://127.24.190.2:45611/ using document root <none> and password file <none>
I20260928 20:15:41.127859 2325 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:41.127933 2325 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:41.128077 2325 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:41.129142 2325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "b3a13b5e528d4ab7b8ffed11d448ed51"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "2dfd6c97522289ac6860284c11c1e04f"
server_key_iv: "ea77d0b90289a35c43837d882dabb7e0"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.129549 2325 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "b3a13b5e528d4ab7b8ffed11d448ed51"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "2dfd6c97522289ac6860284c11c1e04f"
server_key_iv: "ea77d0b90289a35c43837d882dabb7e0"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.130924 2325 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:41.131660 2339 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.131870 2325 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:41.131973 2325 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "b3a13b5e528d4ab7b8ffed11d448ed51"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "2dfd6c97522289ac6860284c11c1e04f"
server_key_iv: "ea77d0b90289a35c43837d882dabb7e0"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.132045 2325 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.141709 2325 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.142019 2325 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.142164 2325 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.142436 2325 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:41.142769 2325 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:41.142822 2325 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.142856 2325 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:41.142882 2325 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.148733 2325 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:35379
I20260928 20:15:41.148782 2453 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:35379 every 8 connection(s)
I20260928 20:15:41.149137 2325 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:41.154402 2173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.149942 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:40449 (local address 127.24.190.62:39121)
0928 20:15:41.150018 (+ 76us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.150021 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.150234 (+ 213us) server_negotiation.cc:407] Connection header received
0928 20:15:41.150833 (+ 599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.150834 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.150844 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.150899 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.151553 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.152076 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.153014 (+ 938us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.153197 (+ 183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.153252 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:41.154067 (+ 815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.154068 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.154068 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.154072 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.154086 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.154089 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.154132 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.154237 (+ 105us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.154262 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:15:41.154690 2456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.149892 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39121 (local address 127.24.190.2:40449)
0928 20:15:41.150106 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:41.150141 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:41.150714 (+ 573us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:41.150951 (+ 237us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:41.150954 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:41.150962 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:41.151478 (+ 516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:41.151483 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.152157 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.152158 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:41.152940 (+ 782us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:41.152942 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.153291 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.153292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:41.153422 (+ 130us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:41.153934 (+ 512us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:41.153935 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:41.153963 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:41.153986 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:41.154148 (+ 162us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:41.154154 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:41.154157 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:41.154224 (+ 67us) client_negotiation.cc:240] Negotiation successful
0928 20:15:41.154385 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":105,"threads_started":1}
I20260928 20:15:41.155237 2454 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39121
I20260928 20:15:41.155355 2454 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:41.155548 2454 heartbeater.cc:511] Master 127.24.190.62:39121 requested a full tablet report, sending...
I20260928 20:15:41.155930 2132 ts_manager.cc:194] Registered new tserver with Master: b3a13b5e528d4ab7b8ffed11d448ed51 (127.24.190.2:35379)
I20260928 20:15:41.156306 2132 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.2:40449
I20260928 20:15:41.156967 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2325
I20260928 20:15:41.157061 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:41.157238 25336 external_mini_cluster.cc:1428] Setting key 07d746bd7808a386424a02663bebca65
I20260928 20:15:41.158095 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39121
--builtin_ntp_servers=127.24.190.20:38313
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260928 20:15:41.240060 2457 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:41.240294 2457 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:41.240319 2457 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:41.241493 2457 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:41.241544 2457 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:41.241576 2457 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:41.243398 2457 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:38313
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39121
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2457
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:41.243657 2457 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:41.243963 2457 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:41.249025 2462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.249073 2465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.249244 2457 server_base.cc:1034] running on GCE node
W20260928 20:15:41.249236 2463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.249548 2457 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:41.249749 2457 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:41.250921 2457 hybrid_clock.cc:648] HybridClock initialized: now 1790626541250901 us; error 35 us; skew 500 ppm
I20260928 20:15:41.252245 2457 webserver.cc:460] Webserver started at http://127.24.190.3:43659/ using document root <none> and password file <none>
I20260928 20:15:41.252494 2457 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:41.252568 2457 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:41.252727 2457 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:41.253810 2457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "8c8b03e35805423c9fc79dd0f6d1faf7"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "05660855d25342f77ffd93a0907594c8"
server_key_iv: "a76af2fa612b1f9cddb1690e8b8d489f"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.254181 2457 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "8c8b03e35805423c9fc79dd0f6d1faf7"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "05660855d25342f77ffd93a0907594c8"
server_key_iv: "a76af2fa612b1f9cddb1690e8b8d489f"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.255545 2457 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:41.256341 2471 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.256536 2457 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:41.256632 2457 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "8c8b03e35805423c9fc79dd0f6d1faf7"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "05660855d25342f77ffd93a0907594c8"
server_key_iv: "a76af2fa612b1f9cddb1690e8b8d489f"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.256716 2457 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.276821 2457 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.277164 2457 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.277318 2457 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.277559 2457 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:41.277941 2457 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:41.277999 2457 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.278041 2457 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:41.278070 2457 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.284184 2457 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:42873
I20260928 20:15:41.284296 2585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:42873 every 8 connection(s)
I20260928 20:15:41.284601 2457 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:41.289939 2173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.285326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:60983 (local address 127.24.190.62:39121)
0928 20:15:41.285372 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.285375 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.285645 (+ 270us) server_negotiation.cc:407] Connection header received
0928 20:15:41.286136 (+ 491us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.286136 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.286147 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.286211 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.287088 (+ 877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.287647 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.288636 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.288824 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.288877 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:41.289688 (+ 811us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.289689 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.289690 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.289694 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.289707 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.289712 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.289754 (+ 42us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.289848 (+ 94us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.289875 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:15:41.290117 2588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.285306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39121 (local address 127.24.190.3:60983)
0928 20:15:41.285504 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:41.285545 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:41.286043 (+ 498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:41.286345 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:41.286350 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:41.286366 (+ 16us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:41.286981 (+ 615us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:41.286987 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.287731 (+ 744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.287732 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:41.288562 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:41.288564 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:41.288916 (+ 352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:41.288917 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:41.289037 (+ 120us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:41.289558 (+ 521us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:41.289558 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:41.289586 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:41.289609 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:41.289767 (+ 158us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:41.289770 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:41.289773 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:41.289828 (+ 55us) client_negotiation.cc:240] Negotiation successful
0928 20:15:41.289908 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":95,"threads_started":1}
I20260928 20:15:41.290787 2586 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39121
I20260928 20:15:41.290889 2586 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:41.291036 2586 heartbeater.cc:511] Master 127.24.190.62:39121 requested a full tablet report, sending...
I20260928 20:15:41.291538 2132 ts_manager.cc:194] Registered new tserver with Master: 8c8b03e35805423c9fc79dd0f6d1faf7 (127.24.190.3:42873)
I20260928 20:15:41.291921 2132 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.3:60983
I20260928 20:15:41.293478 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2457
I20260928 20:15:41.293565 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:41.293730 25336 external_mini_cluster.cc:1428] Setting key 2f4c227ff87968dd55d7b98aba5fbee2
I20260928 20:15:41.294981 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260928 20:15:41.297179 2173 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:41.296538 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51296 (local address 127.24.190.62:39121)
0928 20:15:41.296624 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.296626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.296727 (+ 101us) server_negotiation.cc:407] Connection header received
0928 20:15:41.296869 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.296870 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.296891 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.296954 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.297093 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:51296: BlockingRecv error: recv got EOF from 127.0.0.1:51296 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
I20260928 20:15:41.297268 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2193
I20260928 20:15:41.302295 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2325
I20260928 20:15:41.307646 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2457
I20260928 20:15:41.312233 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2101
2026-09-28T20:15:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (655 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-09-28T20:15:41Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:41Z Disabled control of system clock
I20260928 20:15:41.339829 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:32839
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:39987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:32839
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 20:15:41.421676 2597 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:41.421880 2597 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:41.421901 2597 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:41.423084 2597 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:41.423128 2597 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:41.423141 2597 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:41.423153 2597 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:41.423166 2597 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:41.424542 2597 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:32839
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:32839
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2597
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:41.424743 2597 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:41.424981 2597 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:41.429893 2602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.429947 2603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.430044 2597 server_base.cc:1034] running on GCE node
W20260928 20:15:41.429906 2605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.430469 2597 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:41.430814 2597 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:41.431994 2597 hybrid_clock.cc:648] HybridClock initialized: now 1790626541431998 us; error 46 us; skew 500 ppm
I20260928 20:15:41.433447 2597 webserver.cc:460] Webserver started at http://127.24.190.62:46813/ using document root <none> and password file <none>
I20260928 20:15:41.433739 2597 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:41.433816 2597 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:41.433969 2597 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:41.435158 2597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "29a69ff73cb2461f9363aed27b0aaec6"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "8e0da315a8ff0bd9556075abb30ce660"
server_key_iv: "7323d03e7e047225e6d0b161f1435fcc"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.435518 2597 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "29a69ff73cb2461f9363aed27b0aaec6"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "8e0da315a8ff0bd9556075abb30ce660"
server_key_iv: "7323d03e7e047225e6d0b161f1435fcc"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.436887 2597 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:15:41.437793 2611 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.437978 2597 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:41.438091 2597 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "29a69ff73cb2461f9363aed27b0aaec6"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "8e0da315a8ff0bd9556075abb30ce660"
server_key_iv: "7323d03e7e047225e6d0b161f1435fcc"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.438169 2597 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.442028 2597 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.442356 2597 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.442512 2597 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.446434 2597 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:32839
I20260928 20:15:41.446463 2664 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:32839 every 8 connection(s)
I20260928 20:15:41.446801 2597 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:41.447458 2665 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:41.450224 2665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6: Bootstrap starting.
I20260928 20:15:41.450883 2665 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:41.451193 2665 log.cc:824] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:41.451900 2665 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6: No bootstrap required, opened a new log
I20260928 20:15:41.453507 2665 raft_consensus.cc:348] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a69ff73cb2461f9363aed27b0aaec6" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 32839 } }
I20260928 20:15:41.453670 2665 raft_consensus.cc:374] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:41.453696 2665 raft_consensus.cc:729] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a69ff73cb2461f9363aed27b0aaec6, State: Initialized, Role: FOLLOWER
I20260928 20:15:41.453863 2665 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a69ff73cb2461f9363aed27b0aaec6" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 32839 } }
I20260928 20:15:41.453969 2665 raft_consensus.cc:388] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:41.454012 2665 raft_consensus.cc:482] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:41.454087 2665 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:41.454093 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2597
I20260928 20:15:41.454185 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:41.454442 25336 external_mini_cluster.cc:1428] Setting key a427893f82d521f37f4a5f819926cc4a
I20260928 20:15:41.454872 2665 raft_consensus.cc:504] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a69ff73cb2461f9363aed27b0aaec6" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 32839 } }
I20260928 20:15:41.454998 2665 leader_election.cc:302] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29a69ff73cb2461f9363aed27b0aaec6; no voters:
I20260928 20:15:41.455166 2665 leader_election.cc:288] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:41.455255 2670 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:41.455397 2670 raft_consensus.cc:686] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [term 1 LEADER]: Becoming Leader. State: Replica: 29a69ff73cb2461f9363aed27b0aaec6, State: Running, Role: LEADER
I20260928 20:15:41.455435 2665 sys_catalog.cc:564] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:41.455478 2670 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a69ff73cb2461f9363aed27b0aaec6" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 32839 } }
I20260928 20:15:41.455837 2670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29a69ff73cb2461f9363aed27b0aaec6. Latest consensus state: current_term: 1 leader_uuid: "29a69ff73cb2461f9363aed27b0aaec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a69ff73cb2461f9363aed27b0aaec6" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 32839 } } }
I20260928 20:15:41.455912 2670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:41.456112 2674 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:41.456223 2672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29a69ff73cb2461f9363aed27b0aaec6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a69ff73cb2461f9363aed27b0aaec6" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 32839 } } }
I20260928 20:15:41.456393 2672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:41.456648 2674 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:41.456985 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.454976 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58154 (local address 127.24.190.62:32839)
0928 20:15:41.455218 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.455228 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.455266 (+ 38us) server_negotiation.cc:407] Connection header received
0928 20:15:41.455394 (+ 128us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.455401 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.455448 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.455888 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.456430 (+ 542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.456433 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.456434 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.456438 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.456487 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.456500 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.456717 (+ 217us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.456757 (+ 40us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.456814 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":81,"threads_started":1}
I20260928 20:15:41.458458 2674 catalog_manager.cc:1347] Generated new cluster ID: 1a3dd9b6791a4e798d10db63eebd377b
I20260928 20:15:41.458513 2674 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:15:41.470140 2674 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:41.470358 2674 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:41.490110 2674 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 29a69ff73cb2461f9363aed27b0aaec6: Generated new TSK 0
I20260928 20:15:41.490417 2674 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:15:41.499464 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:32839
--builtin_ntp_servers=127.24.190.20:39987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 20:15:41.604776 2689 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:41.604974 2689 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:41.604997 2689 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:41.606192 2689 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:41.606232 2689 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:41.606259 2689 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:41.607674 2689 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:32839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2689
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:41.607923 2689 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:41.608239 2689 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:15:41.613509 2689 server_base.cc:1034] running on GCE node
W20260928 20:15:41.613471 2695 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.613459 2694 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.613613 2697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.613929 2689 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:41.614192 2689 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:41.615407 2689 hybrid_clock.cc:648] HybridClock initialized: now 1790626541615387 us; error 46 us; skew 500 ppm
I20260928 20:15:41.616765 2689 webserver.cc:460] Webserver started at http://127.24.190.1:33489/ using document root <none> and password file <none>
I20260928 20:15:41.617029 2689 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:41.617100 2689 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:41.617316 2689 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:41.618474 2689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "865949456f3a4c2f83ced67c4e219da4"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "66c20fbf22c84a8b2b18c82b13457bae"
server_key_iv: "c1927a0d272554470cce6015ebb2883d"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.618854 2689 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "865949456f3a4c2f83ced67c4e219da4"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "66c20fbf22c84a8b2b18c82b13457bae"
server_key_iv: "c1927a0d272554470cce6015ebb2883d"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.620237 2689 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:41.621022 2703 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.621209 2689 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:41.621315 2689 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "865949456f3a4c2f83ced67c4e219da4"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "66c20fbf22c84a8b2b18c82b13457bae"
server_key_iv: "c1927a0d272554470cce6015ebb2883d"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.621389 2689 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.624840 2689 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.625133 2689 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.625285 2689 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.625509 2689 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:41.625840 2689 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:41.625872 2689 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.625893 2689 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:41.625937 2689 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.633116 2689 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:41679
I20260928 20:15:41.633147 2818 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:41679 every 8 connection(s)
I20260928 20:15:41.633527 2689 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:41.635229 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2689
I20260928 20:15:41.635334 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:41.635571 25336 external_mini_cluster.cc:1428] Setting key 4ce8259508e260a10132e201396f5184
I20260928 20:15:41.636744 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:32839
--builtin_ntp_servers=127.24.190.20:39987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260928 20:15:41.637239 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.634406 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:38131 (local address 127.24.190.62:32839)
0928 20:15:41.634480 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.634482 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.634715 (+ 233us) server_negotiation.cc:407] Connection header received
0928 20:15:41.635256 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.635257 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.635264 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.635391 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.637011 (+ 1620us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.637012 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.637012 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.637016 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.637032 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.637036 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.637086 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.637173 (+ 87us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.637186 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:15:41.637473 2821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.634347 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:32839 (local address 127.24.190.1:38131)
0928 20:15:41.634545 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:41.634585 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:41.635092 (+ 507us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:41.635501 (+ 409us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:41.635505 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:41.635517 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:41.636850 (+ 1333us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:41.636851 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:41.636893 (+ 42us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:41.636930 (+ 37us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:41.637084 (+ 154us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:41.637088 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:41.637091 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:41.637163 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:15:41.637229 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":83,"threads_started":1}
I20260928 20:15:41.638453 2819 heartbeater.cc:347] Connected to a master server at 127.24.190.62:32839
I20260928 20:15:41.638535 2819 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:41.638746 2819 heartbeater.cc:511] Master 127.24.190.62:32839 requested a full tablet report, sending...
I20260928 20:15:41.639277 2628 ts_manager.cc:194] Registered new tserver with Master: 865949456f3a4c2f83ced67c4e219da4 (127.24.190.1:41679)
W20260928 20:15:41.720927 2822 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:41.721212 2822 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:41.721256 2822 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:41.722487 2822 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:41.722563 2822 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:41.722602 2822 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:41.724123 2822 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:32839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2822
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:41.724388 2822 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:41.724704 2822 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:41.730304 2828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.730324 2830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.730351 2822 server_base.cc:1034] running on GCE node
W20260928 20:15:41.730314 2827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.730763 2822 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:41.730997 2822 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:41.732141 2822 hybrid_clock.cc:648] HybridClock initialized: now 1790626541732130 us; error 32 us; skew 500 ppm
I20260928 20:15:41.733593 2822 webserver.cc:460] Webserver started at http://127.24.190.2:36807/ using document root <none> and password file <none>
I20260928 20:15:41.733888 2822 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:41.733960 2822 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:41.734104 2822 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:41.735239 2822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "6eda0bb226454ab88bceee6d4c6c2339"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "8223f84b8e340df0cdc4093b9f88782f"
server_key_iv: "5dce7e32e66bf8c1db803c6b47708353"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.735596 2822 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "6eda0bb226454ab88bceee6d4c6c2339"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "8223f84b8e340df0cdc4093b9f88782f"
server_key_iv: "5dce7e32e66bf8c1db803c6b47708353"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.736917 2822 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:41.737715 2836 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.737982 2822 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:41.738118 2822 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "6eda0bb226454ab88bceee6d4c6c2339"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "8223f84b8e340df0cdc4093b9f88782f"
server_key_iv: "5dce7e32e66bf8c1db803c6b47708353"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.738248 2822 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.741732 2822 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.742002 2822 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.742103 2822 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.742259 2822 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:41.742565 2822 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:41.742605 2822 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.742625 2822 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:41.742638 2822 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.748309 2822 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:44179
I20260928 20:15:41.748380 2950 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:44179 every 8 connection(s)
I20260928 20:15:41.748639 2822 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:41.751634 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.749363 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:43733 (local address 127.24.190.62:32839)
0928 20:15:41.749449 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.749452 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.749646 (+ 194us) server_negotiation.cc:407] Connection header received
0928 20:15:41.750111 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.750112 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.750117 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.750182 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.751435 (+ 1253us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.751436 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.751437 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.751440 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.751455 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.751459 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.751518 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.751566 (+ 48us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.751577 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 20:15:41.751853 2953 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.749311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:32839 (local address 127.24.190.2:43733)
0928 20:15:41.749493 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:41.749527 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:41.750010 (+ 483us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:41.750235 (+ 225us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:41.750239 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:41.750247 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:41.751291 (+ 1044us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:41.751291 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:41.751319 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:41.751347 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:41.751516 (+ 169us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:41.751519 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:41.751521 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:15:41.751571 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:15:41.751616 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":94,"threads_started":1}
I20260928 20:15:41.752063 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2822
I20260928 20:15:41.752204 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:41.752457 25336 external_mini_cluster.cc:1428] Setting key a809d261a41e27dae7ee2311b5a25205
I20260928 20:15:41.752487 2951 heartbeater.cc:347] Connected to a master server at 127.24.190.62:32839
I20260928 20:15:41.752597 2951 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:41.752811 2951 heartbeater.cc:511] Master 127.24.190.62:32839 requested a full tablet report, sending...
I20260928 20:15:41.753188 2628 ts_manager.cc:194] Registered new tserver with Master: 6eda0bb226454ab88bceee6d4c6c2339 (127.24.190.2:44179)
I20260928 20:15:41.753412 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:32839
--builtin_ntp_servers=127.24.190.20:39987
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260928 20:15:41.874650 2954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:41.875008 2954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:41.875053 2954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:41.877635 2954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:41.877705 2954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:41.877758 2954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:41.880592 2954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39987
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:32839
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.2954
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:41.880927 2954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:41.881356 2954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:15:41.887461 2954 server_base.cc:1034] running on GCE node
W20260928 20:15:41.887435 2960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.887537 2963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:41.887444 2961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:41.887964 2954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:41.888183 2954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:41.889333 2954 hybrid_clock.cc:648] HybridClock initialized: now 1790626541889321 us; error 33 us; skew 500 ppm
I20260928 20:15:41.890784 2954 webserver.cc:460] Webserver started at http://127.24.190.3:36093/ using document root <none> and password file <none>
I20260928 20:15:41.891069 2954 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:41.891119 2954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:41.891307 2954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:41.892486 2954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "e79b2f91f2374942a10aa800e5035b2f"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "0a5683631e6fa54312efa953e0e90f32"
server_key_iv: "8a7e2239ed8a87080f61bd5d256f707c"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.892884 2954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "e79b2f91f2374942a10aa800e5035b2f"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "0a5683631e6fa54312efa953e0e90f32"
server_key_iv: "8a7e2239ed8a87080f61bd5d256f707c"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.894440 2954 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.001s
I20260928 20:15:41.895220 2969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.895406 2954 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:15:41.895530 2954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "e79b2f91f2374942a10aa800e5035b2f"
format_stamp: "Formatted at 2026-09-28 20:15:41 on dist-test-slave-n45k"
server_key: "0a5683631e6fa54312efa953e0e90f32"
server_key_iv: "8a7e2239ed8a87080f61bd5d256f707c"
server_key_version: "encryptionkey@0"
I20260928 20:15:41.895634 2954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:41.899399 2954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:41.899720 2954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:41.899883 2954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:41.900117 2954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:41.900462 2954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:41.900522 2954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.900565 2954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:41.900601 2954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:41.906858 2954 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:44717
I20260928 20:15:41.906932 3082 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:44717 every 8 connection(s)
I20260928 20:15:41.907289 2954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:15:41.910830 2669 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.908043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:45013 (local address 127.24.190.62:32839)
0928 20:15:41.908140 (+ 97us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.908143 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.908463 (+ 320us) server_negotiation.cc:407] Connection header received
0928 20:15:41.908984 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.908985 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.908991 (+ 6us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.909050 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.910572 (+ 1522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:41.910573 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:41.910573 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:15:41.910577 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:41.910593 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:15:41.910597 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:41.910653 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:41.910736 (+ 83us) server_negotiation.cc:299] Negotiation successful
0928 20:15:41.910772 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 20:15:41.911038 3085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:41.907999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:32839 (local address 127.24.190.3:45013)
0928 20:15:41.908253 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:41.908320 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:41.908880 (+ 560us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:41.909109 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:41.909112 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:41.909121 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:41.910342 (+ 1221us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:15:41.910343 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:41.910386 (+ 43us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:15:41.910418 (+ 32us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:41.910668 (+ 250us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:41.910673 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:41.910675 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:15:41.910738 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:15:41.910793 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":192,"thread_start_us":114,"threads_started":1}
I20260928 20:15:41.911682 3083 heartbeater.cc:347] Connected to a master server at 127.24.190.62:32839
I20260928 20:15:41.911778 3083 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:41.911897 3083 heartbeater.cc:511] Master 127.24.190.62:32839 requested a full tablet report, sending...
I20260928 20:15:41.912277 2628 ts_manager.cc:194] Registered new tserver with Master: e79b2f91f2374942a10aa800e5035b2f (127.24.190.3:44717)
I20260928 20:15:41.914100 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 2954
I20260928 20:15:41.914209 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:41.914453 25336 external_mini_cluster.cc:1428] Setting key 207ca94934458f6938c58379cac32518
I20260928 20:15:41.915326 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260928 20:15:41.917347 2669 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:15:41.916734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58162 (local address 127.24.190.62:32839)
0928 20:15:41.916807 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:41.916810 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:41.917007 (+ 197us) server_negotiation.cc:407] Connection header received
0928 20:15:41.917096 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:41.917097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:41.917102 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:41.917147 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:41.917282 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58162: BlockingRecv error: recv got EOF from 127.0.0.1:58162 (error 108)
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 20:15:41.917582 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2689
I20260928 20:15:41.923061 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2822
I20260928 20:15:41.927690 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2954
I20260928 20:15:41.932066 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 2597
2026-09-28T20:15:41Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (619 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:41 dist-test-slave-n45k krb5kdc[3093](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:41 dist-test-slave-n45k krb5kdc[3093](info): set up 2 sockets
Sep 28 20:15:41 dist-test-slave-n45k krb5kdc[3093](info): commencing operation
krb5kdc: starting...
W20260928 20:15:42.979660 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.028s user 0.002s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:15:43.105728 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:33507
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:33507
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:43.188911 3107 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:43.189139 3107 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:43.189163 3107 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:43.190426 3107 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:15:43.190471 3107 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:43.190486 3107 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:43.190500 3107 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:15:43.190511 3107 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:15:43.192015 3107 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:33507
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:33507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3107
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:43.192224 3107 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:43.192396 3107 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:43.197481 3113 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.197445 3112 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:43.197592 3107 server_base.cc:1034] running on GCE node
W20260928 20:15:43.197445 3115 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:43.198050 3107 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:43.198401 3107 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:43.199633 3107 hybrid_clock.cc:648] HybridClock initialized: now 1790626543199588 us; error 26 us; skew 500 ppm
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:43.202440 3107 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:15:43.202975 3107 webserver.cc:460] Webserver started at http://127.24.190.62:43955/ using document root <none> and password file <none>
I20260928 20:15:43.203224 3107 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:43.203302 3107 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:43.203461 3107 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:43.204636 3107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "0fbb5638dd3345868c27ab060b65dbe0"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "72740bee12c12a5e52c064e83ebeceac"
server_key_iv: "f900a1b9dffd45ac2f5b03478485d9c8"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.205036 3107 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "0fbb5638dd3345868c27ab060b65dbe0"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "72740bee12c12a5e52c064e83ebeceac"
server_key_iv: "f900a1b9dffd45ac2f5b03478485d9c8"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.206557 3107 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:15:43.207373 3122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.207556 3107 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:43.207684 3107 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "0fbb5638dd3345868c27ab060b65dbe0"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "72740bee12c12a5e52c064e83ebeceac"
server_key_iv: "f900a1b9dffd45ac2f5b03478485d9c8"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.207765 3107 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:43.219480 3107 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:43.221748 3107 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:43.221909 3107 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:43.225946 3107 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:33507
I20260928 20:15:43.225979 3174 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:33507 every 8 connection(s)
I20260928 20:15:43.226428 3107 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:15:43.227393 3175 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:43.229681 3175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0: Bootstrap starting.
I20260928 20:15:43.230221 3175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:43.230537 3175 log.cc:824] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:43.230787 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 3107
I20260928 20:15:43.230882 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:15:43.231040 25336 external_mini_cluster.cc:1428] Setting key 585e21c438eb007478ea4ec21494e486
I20260928 20:15:43.231432 3175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0: No bootstrap required, opened a new log
I20260928 20:15:43.233407 3175 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb5638dd3345868c27ab060b65dbe0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 33507 } }
I20260928 20:15:43.233585 3175 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:43.233651 3175 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0fbb5638dd3345868c27ab060b65dbe0, State: Initialized, Role: FOLLOWER
I20260928 20:15:43.233844 3175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb5638dd3345868c27ab060b65dbe0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 33507 } }
I20260928 20:15:43.233949 3175 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:15:43.233999 3175 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:15:43.234051 3175 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:43.234762 3175 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb5638dd3345868c27ab060b65dbe0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 33507 } }
I20260928 20:15:43.234892 3175 leader_election.cc:302] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0fbb5638dd3345868c27ab060b65dbe0; no voters:
I20260928 20:15:43.235080 3175 leader_election.cc:288] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:15:43.235116 3180 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:43.235351 3175 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:15:43.235360 3180 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [term 1 LEADER]: Becoming Leader. State: Replica: 0fbb5638dd3345868c27ab060b65dbe0, State: Running, Role: LEADER
I20260928 20:15:43.235522 3180 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb5638dd3345868c27ab060b65dbe0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 33507 } }
I20260928 20:15:43.235898 3182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0fbb5638dd3345868c27ab060b65dbe0. Latest consensus state: current_term: 1 leader_uuid: "0fbb5638dd3345868c27ab060b65dbe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb5638dd3345868c27ab060b65dbe0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 33507 } } }
I20260928 20:15:43.236073 3182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:43.236014 3181 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0fbb5638dd3345868c27ab060b65dbe0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0fbb5638dd3345868c27ab060b65dbe0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 33507 } } }
I20260928 20:15:43.236287 3181 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0 [sys.catalog]: This master's current role is: LEADER
I20260928 20:15:43.236616 3189 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:15:43.237118 3189 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:15:43.238893 3189 catalog_manager.cc:1347] Generated new cluster ID: 5a7f25c165794244bb331a69f02d3672
I20260928 20:15:43.238943 3189 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:43.243978 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.231606 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54404 (local address 127.24.190.62:33507)
0928 20:15:43.231809 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.231816 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.231841 (+ 25us) server_negotiation.cc:407] Connection header received
0928 20:15:43.232701 (+ 860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.232707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.232780 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.232933 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:43.233571 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.234897 (+ 1326us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.236181 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.236942 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.237074 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.240265 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:43.240269 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:43.240269 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:43.240282 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:43.242236 (+ 1954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.242723 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.242726 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.242726 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.242829 (+ 103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.243067 (+ 238us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.243068 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.243069 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.243339 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:43.243520 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.243640 (+ 120us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.243794 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260928 20:15:43.268913 3189 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:15:43.269551 3189 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:15:43.273828 3189 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0: Generated new TSK 0
I20260928 20:15:43.274026 3189 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:15:43.312793 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:33507
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:43.419348 3201 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:43.419575 3201 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:43.419601 3201 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:43.420734 3201 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:43.420774 3201 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:43.420801 3201 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:15:43.422202 3201 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:33507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3201
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:43.422465 3201 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:43.422729 3201 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:43.427853 3206 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.427846 3207 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.427843 3209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:43.428061 3201 server_base.cc:1034] running on GCE node
I20260928 20:15:43.428406 3201 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:43.428632 3201 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:43.429829 3201 hybrid_clock.cc:648] HybridClock initialized: now 1790626543429822 us; error 36 us; skew 500 ppm
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:43.432641 3201 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:15:43.433212 3201 webserver.cc:460] Webserver started at http://127.24.190.1:36033/ using document root <none> and password file <none>
I20260928 20:15:43.433439 3201 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:43.433506 3201 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:43.433655 3201 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:43.434753 3201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "32034f28034b4c5492eb042fb5cb9fea"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "fd02068911f81a5657dff06d12ee4f91"
server_key_iv: "e84197662ff15a8a171917f1cced50ba"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.435122 3201 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "32034f28034b4c5492eb042fb5cb9fea"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "fd02068911f81a5657dff06d12ee4f91"
server_key_iv: "e84197662ff15a8a171917f1cced50ba"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.436563 3201 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s
I20260928 20:15:43.437381 3216 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.437645 3201 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:43.437752 3201 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "32034f28034b4c5492eb042fb5cb9fea"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "fd02068911f81a5657dff06d12ee4f91"
server_key_iv: "e84197662ff15a8a171917f1cced50ba"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.437825 3201 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:43.447180 3201 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:43.449113 3201 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:43.449267 3201 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:43.449489 3201 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:43.449793 3201 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:43.449847 3201 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.449889 3201 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:43.449915 3201 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.456034 3201 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:33151
I20260928 20:15:43.456085 3330 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:33151 every 8 connection(s)
I20260928 20:15:43.456396 3201 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:15:43.458765 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 3201
I20260928 20:15:43.458870 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:15:43.459075 25336 external_mini_cluster.cc:1428] Setting key d7282ca33bd2307c7df5da4738c465bb
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:43.467120 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.457016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:35793 (local address 127.24.190.62:33507)
0928 20:15:43.457061 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.457063 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.457285 (+ 222us) server_negotiation.cc:407] Connection header received
0928 20:15:43.457838 (+ 553us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.457839 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.457852 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.457911 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:43.459044 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.459821 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.461385 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.461610 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.461691 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.464231 (+ 2540us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:43.464232 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:43.464232 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:43.464253 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:43.465659 (+ 1406us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.466108 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.466109 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.466110 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.466171 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.466470 (+ 299us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.466471 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.466471 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.466586 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:43.466665 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.466940 (+ 275us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.467029 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:15:43.467334 3333 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.456987 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:33507 (local address 127.24.190.1:35793)
0928 20:15:43.457140 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.457191 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.457726 (+ 535us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.457980 (+ 254us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.457984 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.458648 (+ 664us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:43.458937 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.458946 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.459942 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.459943 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.461295 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.461299 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.461702 (+ 403us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.461703 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.461838 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.462395 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:43.462403 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:43.464126 (+ 1723us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:43.465794 (+ 1668us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:43.465802 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:43.465804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:43.466029 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:43.466249 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:43.466249 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:43.466250 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:43.466394 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:43.466654 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:43.466660 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:43.466803 (+ 143us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.466907 (+ 104us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.467064 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":74,"threads_started":1}
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:15:43.467809 3331 heartbeater.cc:347] Connected to a master server at 127.24.190.62:33507
I20260928 20:15:43.467917 3331 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:43.468101 3331 heartbeater.cc:511] Master 127.24.190.62:33507 requested a full tablet report, sending...
I20260928 20:15:43.468665 3139 ts_manager.cc:194] Registered new tserver with Master: 32034f28034b4c5492eb042fb5cb9fea (127.24.190.1:33151)
I20260928 20:15:43.469274 3139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:35793
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:15:43.485791 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:33507
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:43.569495 3336 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:43.569698 3336 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:43.569723 3336 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:43.571017 3336 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:43.571063 3336 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:43.571090 3336 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:15:43.572649 3336 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:33507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3336
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:43.572906 3336 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:43.573134 3336 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:15:43.578307 3342 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.578313 3341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.578293 3344 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:43.578409 3336 server_base.cc:1034] running on GCE node
I20260928 20:15:43.578596 3336 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:43.578819 3336 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:43.579964 3336 hybrid_clock.cc:648] HybridClock initialized: now 1790626543579954 us; error 27 us; skew 500 ppm
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:43.582576 3336 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:15:43.583006 3336 webserver.cc:460] Webserver started at http://127.24.190.2:43801/ using document root <none> and password file <none>
I20260928 20:15:43.583196 3336 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:43.583236 3336 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:43.583328 3336 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:43.584338 3336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "0e16497eabdb4e119d8624b6ec7bcfed"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "f7bb6a6e9f45420d9f3faf85d4138324"
server_key_iv: "7262f85169cc9d5492279b307c9106e5"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.584619 3336 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "0e16497eabdb4e119d8624b6ec7bcfed"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "f7bb6a6e9f45420d9f3faf85d4138324"
server_key_iv: "7262f85169cc9d5492279b307c9106e5"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.585824 3336 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:15:43.586607 3351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.586851 3336 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:15:43.586937 3336 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "0e16497eabdb4e119d8624b6ec7bcfed"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "f7bb6a6e9f45420d9f3faf85d4138324"
server_key_iv: "7262f85169cc9d5492279b307c9106e5"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.586992 3336 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:43.596731 3336 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:43.599035 3336 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:43.599144 3336 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:43.599318 3336 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:43.599576 3336 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:43.599615 3336 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.599637 3336 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:43.599649 3336 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.605139 3336 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:33561
I20260928 20:15:43.605224 3465 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:33561 every 8 connection(s)
I20260928 20:15:43.605532 3336 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:15:43.610904 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 3336
I20260928 20:15:43.611016 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:15:43.611217 25336 external_mini_cluster.cc:1428] Setting key dd914044b56f6827b51585affe39a90e
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:43.615355 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.606329 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:41539 (local address 127.24.190.62:33507)
0928 20:15:43.606376 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.606378 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.606539 (+ 161us) server_negotiation.cc:407] Connection header received
0928 20:15:43.607004 (+ 465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.607005 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.607014 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.607066 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:43.607975 (+ 909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.608585 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.609754 (+ 1169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.609952 (+ 198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.610145 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.612471 (+ 2326us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:43.612473 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:43.612473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:43.612481 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:43.613921 (+ 1440us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.614434 (+ 513us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.614435 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.614435 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.614486 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.614766 (+ 280us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.614766 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.614766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.614865 (+ 99us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:43.614912 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.615229 (+ 317us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.615294 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:15:43.615643 3468 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.606234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:33507 (local address 127.24.190.2:41539)
0928 20:15:43.606412 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.606453 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.606925 (+ 472us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.607125 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.607128 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.607670 (+ 542us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:43.607859 (+ 189us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.607864 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.608703 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.608705 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.609656 (+ 951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.609658 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.610169 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.610170 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.610340 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.610817 (+ 477us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:43.610827 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:43.612385 (+ 1558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:43.614003 (+ 1618us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:43.614009 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:43.614011 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:43.614362 (+ 351us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:43.614553 (+ 191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:43.614553 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:43.614554 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:43.614696 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:43.614926 (+ 230us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:43.614931 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:43.615092 (+ 161us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.615197 (+ 105us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.615373 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":112,"threads_started":1}
I20260928 20:15:43.616161 3466 heartbeater.cc:347] Connected to a master server at 127.24.190.62:33507
I20260928 20:15:43.616302 3466 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:43.616483 3466 heartbeater.cc:511] Master 127.24.190.62:33507 requested a full tablet report, sending...
I20260928 20:15:43.616914 3139 ts_manager.cc:194] Registered new tserver with Master: 0e16497eabdb4e119d8624b6ec7bcfed (127.24.190.2:33561)
I20260928 20:15:43.617300 3139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:41539
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:15:43.637513 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:33507
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39935
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:15:43.720468 3471 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:15:43.720695 3471 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:15:43.720733 3471 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:15:43.721897 3471 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:15:43.721968 3471 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:15:43.722013 3471 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:15:43.723536 3471 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39935
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:33507
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.3471
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:15:43.723798 3471 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:15:43.724022 3471 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:15:43.729171 3471 server_base.cc:1034] running on GCE node
W20260928 20:15:43.729166 3477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.729168 3479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:15:43.729239 3476 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:15:43.729678 3471 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:15:43.729954 3471 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:15:43.731118 3471 hybrid_clock.cc:648] HybridClock initialized: now 1790626543731083 us; error 69 us; skew 500 ppm
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:15:43.733696 3471 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:15:43.734181 3471 webserver.cc:460] Webserver started at http://127.24.190.3:35339/ using document root <none> and password file <none>
I20260928 20:15:43.734611 3471 fs_manager.cc:359] Metadata directory not provided
I20260928 20:15:43.734820 3471 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:15:43.735004 3471 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:15:43.736502 3471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "370257d2334d4fdb9f41e0c4ed0da6d6"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "4e6fa5ace6f89f44b0ed0139d3ed38ed"
server_key_iv: "2ef8ab5092c4acf2caf89cee16502498"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.736967 3471 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "370257d2334d4fdb9f41e0c4ed0da6d6"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "4e6fa5ace6f89f44b0ed0139d3ed38ed"
server_key_iv: "2ef8ab5092c4acf2caf89cee16502498"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.738653 3471 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.004s sys 0.000s
I20260928 20:15:43.739595 3486 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.739789 3471 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:15:43.739897 3471 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "370257d2334d4fdb9f41e0c4ed0da6d6"
format_stamp: "Formatted at 2026-09-28 20:15:43 on dist-test-slave-n45k"
server_key: "4e6fa5ace6f89f44b0ed0139d3ed38ed"
server_key_iv: "2ef8ab5092c4acf2caf89cee16502498"
server_key_version: "encryptionkey@0"
I20260928 20:15:43.739992 3471 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:15:43.765805 3471 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:15:43.768059 3471 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:15:43.768231 3471 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:15:43.768482 3471 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:15:43.768795 3471 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:15:43.768848 3471 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.768889 3471 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:15:43.768918 3471 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:15:43.774818 3471 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:41993
I20260928 20:15:43.774891 3600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:41993 every 8 connection(s)
I20260928 20:15:43.775216 3471 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626543, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:15:43.783298 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 3471
I20260928 20:15:43.783383 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:15:43.783617 25336 external_mini_cluster.cc:1428] Setting key 64458f86ccd2b56e9ac72b13f9c712c7
I20260928 20:15:43.784946 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.775981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:40615 (local address 127.24.190.62:33507)
0928 20:15:43.776044 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.776046 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.776281 (+ 235us) server_negotiation.cc:407] Connection header received
0928 20:15:43.776799 (+ 518us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.776800 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.776809 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.776865 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:43.777765 (+ 900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.778260 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.779381 (+ 1121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.779561 (+ 180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.779614 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.782020 (+ 2406us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:43.782022 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:43.782022 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:43.782027 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:43.783508 (+ 1481us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.783993 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.783994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.783994 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.784059 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.784308 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.784309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.784309 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.784427 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:43.784503 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.784775 (+ 272us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.784854 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 20:15:43.785140 3603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.775967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:33507 (local address 127.24.190.3:40615)
0928 20:15:43.776135 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.776185 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.776699 (+ 514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.776919 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.776923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.777476 (+ 553us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:15:43.777681 (+ 205us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.777685 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.778404 (+ 719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.778405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.779278 (+ 873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.779281 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.779667 (+ 386us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.779668 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.779779 (+ 111us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.780451 (+ 672us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:15:43.780460 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:15:43.781935 (+ 1475us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:15:43.783588 (+ 1653us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:43.783595 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:43.783598 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:43.783889 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:43.784127 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:15:43.784128 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:15:43.784128 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:15:43.784233 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:15:43.784493 (+ 260us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:15:43.784499 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:15:43.784636 (+ 137us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.784755 (+ 119us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.784910 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":203,"threads_started":1}
I20260928 20:15:43.785573 3601 heartbeater.cc:347] Connected to a master server at 127.24.190.62:33507
I20260928 20:15:43.785663 3601 heartbeater.cc:464] Registering TS with master...
I20260928 20:15:43.785954 3601 heartbeater.cc:511] Master 127.24.190.62:33507 requested a full tablet report, sending...
I20260928 20:15:43.786338 3139 ts_manager.cc:194] Registered new tserver with Master: 370257d2334d4fdb9f41e0c4ed0da6d6 (127.24.190.3:41993)
I20260928 20:15:43.786717 3139 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:40615
I20260928 20:15:43.795228 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:15:43.802920 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.796528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54420 (local address 127.24.190.62:33507)
0928 20:15:43.796589 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.796591 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.796703 (+ 112us) server_negotiation.cc:407] Connection header received
0928 20:15:43.796741 (+ 38us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.796742 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.796751 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.796794 (+ 43us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:15:43.797350 (+ 556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.797835 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.798626 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.798825 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.798886 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.800032 (+ 1146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:15:43.800033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:15:43.800033 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:15:43.800040 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:15:43.801632 (+ 1592us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.801974 (+ 342us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.801975 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.801975 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.802031 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:15:43.802394 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:15:43.802395 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:15:43.802395 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:15:43.802560 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:15:43.802646 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.802762 (+ 116us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.802826 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 20:15:43.804487 3139 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54420:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:15:43.806084 3139 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:15:43.812832 3613 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.808547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:33151 (local address 127.0.0.1:50304)
0928 20:15:43.808694 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.808739 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.808807 (+ 68us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.809066 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.809069 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.809072 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:43.809142 (+ 70us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.809144 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.810359 (+ 1215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.810360 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.811647 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.811649 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.812523 (+ 874us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.812524 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.812603 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.812617 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.812692 (+ 75us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.812744 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":54,"threads_started":1}
I20260928 20:15:43.812856 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.808672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50304 (local address 127.24.190.1:33151)
0928 20:15:43.808892 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.808897 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.808906 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:43.808941 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.808943 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.808965 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.809045 (+ 80us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:43.809198 (+ 153us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.810237 (+ 1039us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.811730 (+ 1493us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.812430 (+ 700us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.812507 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.812566 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.812722 (+ 156us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.812777 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":190,"thread_start_us":92,"threads_started":1}
I20260928 20:15:43.813052 3612 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.808547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:41993 (local address 127.0.0.1:34928)
0928 20:15:43.808868 (+ 321us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.808878 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.808929 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.809447 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.809448 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.809450 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:43.809499 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.809500 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.810883 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.810883 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.811890 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.811892 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.812805 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.812806 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.812874 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.812879 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.812911 (+ 32us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.812962 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":308,"mutex_wait_us":2,"thread_start_us":83,"threads_started":1}
I20260928 20:15:43.813478 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.808708 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34928 (local address 127.24.190.3:41993)
0928 20:15:43.809288 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.809293 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.809301 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:15:43.809335 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.809337 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.809351 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.809572 (+ 221us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:43.809644 (+ 72us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.810774 (+ 1130us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.811974 (+ 1200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.812706 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.813220 (+ 514us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.813337 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.813365 (+ 28us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.813404 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":81,"threads_started":1}
I20260928 20:15:43.813802 3265 tablet_service.cc:1467] Processing CreateTablet for tablet 980c1ff2cc0a470ca969f45de2a9172b (DEFAULT_TABLE table=test-table [id=b0d00eb8bf1e40489fcf1308ab0ebedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:43.813987 3616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.808735 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33561 (local address 127.0.0.1:34168)
0928 20:15:43.809106 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.809116 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.809165 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.809405 (+ 240us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.809406 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.809408 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:43.809455 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.809457 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.811977 (+ 2520us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.811978 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.812727 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.812729 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.813760 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.813761 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.813829 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.813833 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.813889 (+ 56us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.813927 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":353,"thread_start_us":66,"threads_started":1}
I20260928 20:15:43.814190 3265 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 980c1ff2cc0a470ca969f45de2a9172b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:43.814220 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.808952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34168 (local address 127.24.190.2:33561)
0928 20:15:43.809091 (+ 139us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.809096 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.809159 (+ 63us) server_negotiation.cc:407] Connection header received
0928 20:15:43.809241 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.809243 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.809258 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.809335 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:43.809602 (+ 267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.810785 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.812824 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.813664 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.813762 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.813829 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.814091 (+ 262us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.814142 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260928 20:15:43.814917 3400 tablet_service.cc:1467] Processing CreateTablet for tablet 980c1ff2cc0a470ca969f45de2a9172b (DEFAULT_TABLE table=test-table [id=b0d00eb8bf1e40489fcf1308ab0ebedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:43.814919 3535 tablet_service.cc:1467] Processing CreateTablet for tablet 980c1ff2cc0a470ca969f45de2a9172b (DEFAULT_TABLE table=test-table [id=b0d00eb8bf1e40489fcf1308ab0ebedd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:15:43.815238 3400 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 980c1ff2cc0a470ca969f45de2a9172b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:43.815233 3535 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 980c1ff2cc0a470ca969f45de2a9172b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:15:43.817595 3618 tablet_bootstrap.cc:492] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea: Bootstrap starting.
I20260928 20:15:43.818356 3620 tablet_bootstrap.cc:492] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Bootstrap starting.
I20260928 20:15:43.818403 3618 tablet_bootstrap.cc:654] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:43.818499 3619 tablet_bootstrap.cc:492] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Bootstrap starting.
I20260928 20:15:43.819031 3620 tablet_bootstrap.cc:654] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:43.819043 3619 tablet_bootstrap.cc:654] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Neither blocks nor log segments found. Creating new log.
I20260928 20:15:43.819135 3618 log.cc:824] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:43.819547 3620 log.cc:824] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:43.819617 3619 log.cc:824] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Log is configured to *not* fsync() on all Append() calls
I20260928 20:15:43.820266 3620 tablet_bootstrap.cc:492] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: No bootstrap required, opened a new log
I20260928 20:15:43.820299 3618 tablet_bootstrap.cc:492] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea: No bootstrap required, opened a new log
I20260928 20:15:43.820349 3620 ts_tablet_manager.cc:1397] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:15:43.820370 3619 tablet_bootstrap.cc:492] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: No bootstrap required, opened a new log
I20260928 20:15:43.820417 3618 ts_tablet_manager.cc:1397] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260928 20:15:43.820431 3619 ts_tablet_manager.cc:1397] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:15:43.821758 3619 raft_consensus.cc:348] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.821913 3619 raft_consensus.cc:374] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:43.821955 3619 raft_consensus.cc:729] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e16497eabdb4e119d8624b6ec7bcfed, State: Initialized, Role: FOLLOWER
I20260928 20:15:43.822099 3619 consensus_queue.cc:260] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.822417 3619 ts_tablet_manager.cc:1428] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:15:43.822320 3620 raft_consensus.cc:348] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.822469 3620 raft_consensus.cc:374] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:43.822501 3620 raft_consensus.cc:729] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 370257d2334d4fdb9f41e0c4ed0da6d6, State: Initialized, Role: FOLLOWER
I20260928 20:15:43.822549 3466 heartbeater.cc:503] Master 127.24.190.62:33507 was elected leader, sending a full tablet report...
I20260928 20:15:43.822602 3620 consensus_queue.cc:260] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.822858 3620 ts_tablet_manager.cc:1428] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:15:43.822914 3601 heartbeater.cc:503] Master 127.24.190.62:33507 was elected leader, sending a full tablet report...
I20260928 20:15:43.822391 3618 raft_consensus.cc:348] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.823320 3618 raft_consensus.cc:374] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:15:43.823559 3618 raft_consensus.cc:729] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32034f28034b4c5492eb042fb5cb9fea, State: Initialized, Role: FOLLOWER
I20260928 20:15:43.823696 3618 consensus_queue.cc:260] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.824009 3331 heartbeater.cc:503] Master 127.24.190.62:33507 was elected leader, sending a full tablet report...
I20260928 20:15:43.824015 3618 ts_tablet_manager.cc:1428] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
W20260928 20:15:43.856108 3467 tablet.cc:2369] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:15:43.883173 3625 raft_consensus.cc:482] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:15:43.883327 3625 raft_consensus.cc:504] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.883731 3625 leader_election.cc:288] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e16497eabdb4e119d8624b6ec7bcfed (127.24.190.2:33561), 32034f28034b4c5492eb042fb5cb9fea (127.24.190.1:33151)
I20260928 20:15:43.887650 3603 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.883878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33561 (local address 127.24.190.3:34353)
0928 20:15:43.883940 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.883951 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.883994 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.884171 (+ 177us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.884172 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.884174 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:43.884269 (+ 95us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.884271 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.885272 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.885272 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.886572 (+ 1300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.886575 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.887352 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.887353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.887440 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.887443 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.887503 (+ 60us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.887558 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":43,"mutex_wait_us":78}
I20260928 20:15:43.887674 3614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.883960 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:46045 (local address 127.24.190.1:33151)
0928 20:15:43.884013 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.884016 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.884144 (+ 128us) server_negotiation.cc:407] Connection header received
0928 20:15:43.884214 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.884216 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.884225 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.884268 (+ 43us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:43.884431 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.885119 (+ 688us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.886663 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.887258 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.887338 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.887347 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.887553 (+ 206us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.887616 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 20:15:43.887671 3617 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.883935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:34353 (local address 127.24.190.2:33561)
0928 20:15:43.883977 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.883979 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.883988 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:43.884072 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.884073 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.884085 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.884144 (+ 59us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:15:43.884356 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.885103 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.886662 (+ 1559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.887272 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.887338 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.887347 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.887553 (+ 206us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.887600 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:15:43.887696 3627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.883879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:33151 (local address 127.24.190.3:46045)
0928 20:15:43.884070 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.884086 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0928 20:15:43.884156 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:15:43.884287 (+ 131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:15:43.884287 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:15:43.884289 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:15:43.884353 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.884354 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.885190 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.885190 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.886573 (+ 1383us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:15:43.886575 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.887352 (+ 777us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.887353 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:15:43.887435 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.887439 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:15:43.887503 (+ 64us) client_negotiation.cc:240] Negotiation successful
0928 20:15:43.887558 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":58,"thread_start_us":125,"threads_started":1}
I20260928 20:15:43.888044 3420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "980c1ff2cc0a470ca969f45de2a9172b" candidate_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" is_pre_election: true
I20260928 20:15:43.888314 3420 raft_consensus.cc:2454] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 370257d2334d4fdb9f41e0c4ed0da6d6 in term 0.
I20260928 20:15:43.888316 3285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "980c1ff2cc0a470ca969f45de2a9172b" candidate_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32034f28034b4c5492eb042fb5cb9fea" is_pre_election: true
I20260928 20:15:43.888485 3285 raft_consensus.cc:2454] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 370257d2334d4fdb9f41e0c4ed0da6d6 in term 0.
I20260928 20:15:43.888568 3488 leader_election.cc:302] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e16497eabdb4e119d8624b6ec7bcfed, 370257d2334d4fdb9f41e0c4ed0da6d6; no voters:
I20260928 20:15:43.888710 3625 raft_consensus.cc:2781] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:15:43.888778 3625 raft_consensus.cc:482] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:15:43.888795 3625 raft_consensus.cc:3037] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:43.889855 3625 raft_consensus.cc:504] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.889985 3625 leader_election.cc:288] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [CANDIDATE]: Term 1 election: Requested vote from peers 0e16497eabdb4e119d8624b6ec7bcfed (127.24.190.2:33561), 32034f28034b4c5492eb042fb5cb9fea (127.24.190.1:33151)
I20260928 20:15:43.890166 3285 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "980c1ff2cc0a470ca969f45de2a9172b" candidate_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "32034f28034b4c5492eb042fb5cb9fea"
I20260928 20:15:43.890241 3420 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "980c1ff2cc0a470ca969f45de2a9172b" candidate_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e16497eabdb4e119d8624b6ec7bcfed"
I20260928 20:15:43.890256 3285 raft_consensus.cc:3037] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:43.890331 3420 raft_consensus.cc:3037] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:15:43.891220 3285 raft_consensus.cc:2454] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 370257d2334d4fdb9f41e0c4ed0da6d6 in term 1.
I20260928 20:15:43.891220 3420 raft_consensus.cc:2454] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 370257d2334d4fdb9f41e0c4ed0da6d6 in term 1.
I20260928 20:15:43.891415 3490 leader_election.cc:302] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 32034f28034b4c5492eb042fb5cb9fea, 370257d2334d4fdb9f41e0c4ed0da6d6; no voters:
I20260928 20:15:43.891526 3625 raft_consensus.cc:2781] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:15:43.891718 3625 raft_consensus.cc:686] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 1 LEADER]: Becoming Leader. State: Replica: 370257d2334d4fdb9f41e0c4ed0da6d6, State: Running, Role: LEADER
I20260928 20:15:43.891836 3625 consensus_queue.cc:237] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } }
I20260928 20:15:43.892724 3137 catalog_manager.cc:5495] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 370257d2334d4fdb9f41e0c4ed0da6d6 (127.24.190.3). New cstate: current_term: 1 leader_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "370257d2334d4fdb9f41e0c4ed0da6d6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 41993 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 } health_report { overall_health: UNKNOWN } } }
I20260928 20:15:43.904971 3615 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.902515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34938 (local address 127.24.190.3:41993)
0928 20:15:43.902577 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0928 20:15:43.902579 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:15:43.902588 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:15:43.902655 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:15:43.902656 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:15:43.902674 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:15:43.902758 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:15:43.902895 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.903399 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.904188 (+ 789us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:15:43.904389 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:15:43.904459 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:15:43.904631 (+ 172us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:15:43.904732 (+ 101us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:15:43.904826 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:15:43.904844 (+ 18us) server_negotiation.cc:299] Negotiation successful
0928 20:15:43.904863 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 20:15:43.906733 3285 raft_consensus.cc:1261] T 980c1ff2cc0a470ca969f45de2a9172b P 32034f28034b4c5492eb042fb5cb9fea [term 1 FOLLOWER]: Refusing update from remote peer 370257d2334d4fdb9f41e0c4ed0da6d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:43.906731 3420 raft_consensus.cc:1261] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 1 FOLLOWER]: Refusing update from remote peer 370257d2334d4fdb9f41e0c4ed0da6d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:15:43.907094 3628 consensus_queue.cc:1035] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e16497eabdb4e119d8624b6ec7bcfed" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:43.907243 3625 consensus_queue.cc:1035] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "32034f28034b4c5492eb042fb5cb9fea" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 33151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:15:43.909446 3631 mvcc.cc:205] Tried to move back new op lower bound from 7334406323839188992 to 7334406323781685248. Current Snapshot: MvccSnapshot[applied={T|T < 7334406323839188992}]
I20260928 20:15:43.909848 3633 mvcc.cc:205] Tried to move back new op lower bound from 7334406323839188992 to 7334406323781685248. Current Snapshot: MvccSnapshot[applied={T|T < 7334406323839188992}]
I20260928 20:15:43.912190 3138 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:43.912302 3138 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54420:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:15:43.913049 3138 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 0fbb5638dd3345868c27ab060b65dbe0: Sending DeleteTablet for 3 replicas of tablet 980c1ff2cc0a470ca969f45de2a9172b
I20260928 20:15:43.913364 3535 tablet_service.cc:1514] Processing DeleteTablet for tablet 980c1ff2cc0a470ca969f45de2a9172b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:43 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:34928
I20260928 20:15:43.913393 3400 tablet_service.cc:1514] Processing DeleteTablet for tablet 980c1ff2cc0a470ca969f45de2a9172b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:43 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:34168
I20260928 20:15:43.913622 3641 tablet_replica.cc:330] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: stopping tablet replica
I20260928 20:15:43.913657 3265 tablet_service.cc:1514] Processing DeleteTablet for tablet 980c1ff2cc0a470ca969f45de2a9172b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:15:43 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50304
I20260928 20:15:43.913772 3640 tablet_replica.cc:330] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: stopping tablet replica
I20260928 20:15:43.913862 3640 raft_consensus.cc:2229] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:15:43.913957 3640 raft_consensus.cc:2258] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:43.913975 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 3201
I20260928 20:15:43.915125 3640 ts_tablet_manager.cc:1905] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:43.917081 3640 ts_tablet_manager.cc:1918] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:43.917145 3640 log.cc:1196] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/980c1ff2cc0a470ca969f45de2a9172b
I20260928 20:15:43.917440 3640 ts_tablet_manager.cc:1939] T 980c1ff2cc0a470ca969f45de2a9172b P 370257d2334d4fdb9f41e0c4ed0da6d6: Deleting consensus metadata
I20260928 20:15:43.917505 3641 raft_consensus.cc:2229] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:15:43.917625 3641 raft_consensus.cc:2258] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:15:43.917811 3124 catalog_manager.cc:4841] TS 370257d2334d4fdb9f41e0c4ed0da6d6 (127.24.190.3:41993): tablet 980c1ff2cc0a470ca969f45de2a9172b (table test-table [id=b0d00eb8bf1e40489fcf1308ab0ebedd]) successfully deleted
I20260928 20:15:43.918133 3641 ts_tablet_manager.cc:1905] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:15:43.919482 3641 ts_tablet_manager.cc:1918] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:15:43.919561 3641 log.cc:1196] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/980c1ff2cc0a470ca969f45de2a9172b
I20260928 20:15:43.919829 3641 ts_tablet_manager.cc:1939] T 980c1ff2cc0a470ca969f45de2a9172b P 0e16497eabdb4e119d8624b6ec7bcfed: Deleting consensus metadata
I20260928 20:15:43.920265 3124 catalog_manager.cc:4841] TS 0e16497eabdb4e119d8624b6ec7bcfed (127.24.190.2:33561): tablet 980c1ff2cc0a470ca969f45de2a9172b (table test-table [id=b0d00eb8bf1e40489fcf1308ab0ebedd]) successfully deleted
W20260928 20:15:43.922315 3126 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:33151 (error 108)
I20260928 20:15:43.922541 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 3336
I20260928 20:15:43.923403 3616 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:15:43.922778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:33151 (local address 127.0.0.1:50306)
0928 20:15:43.923333 (+ 555us) negotiation.cc:107] Waiting for socket to connect
0928 20:15:43.923376 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:33151: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":536}
W20260928 20:15:43.923743 3126 catalog_manager.cc:4584] TS 32034f28034b4c5492eb042fb5cb9fea (127.24.190.1:33151): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 980c1ff2cc0a470ca969f45de2a9172b: Network error: Client connection negotiation failed: client connection to 127.24.190.1:33151: connect: Connection refused (error 111)
I20260928 20:15:43.927695 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 3471
I20260928 20:15:43.931782 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 3107
2026-09-28T20:15:43Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (2000 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3646](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3646](info): set up 2 sockets
Sep 28 20:15:43 dist-test-slave-n45k krb5kdc[3646](info): commencing operation
krb5kdc: starting...
W20260928 20:15:44.991686 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.039s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:15:45 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626545, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:15:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:15:45Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/rangeradmin_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/rangeradmin_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/rangerlookup_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/rangerlookup_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
I20260928 20:15:45.165460 25336 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJmbe_f/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/postgres -l logfile start
2026-09-28 20:15:47.793 UTC [3676] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-28 20:15:47.793 UTC [3676] LOG: listening on IPv4 address "127.24.190.20", port 34953
2026-09-28 20:15:47.797 UTC [3676] LOG: listening on Unix socket "/tmp/.s.PGSQL.34953"
2026-09-28 20:15:47.836 UTC [3679] LOG: database system was shut down at 2026-09-28 20:15:46 UTC
2026-09-28 20:15:47.840 UTC [3676] LOG: database system is ready to accept connections
I20260928 20:15:48.855923 25336 mini_postgres.cc:96] Postgres bound to 34953
2026-09-28 20:15:48.862 UTC [3687] FATAL: database "slave" does not exist
127.24.190.20:34953 - accepting connections
I20260928 20:15:48.863083 25336 mini_ranger.cc:161] Starting Ranger...
I20260928 20:15:48.878010 25336 mini_ranger.cc:84] Created miniranger Postgres user
I20260928 20:15:49.406417 25336 mini_ranger.cc:87] Created ranger Postgres database
I20260928 20:15:49.406517 25336 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-admin
2026-09-28 20:15:49,702 [I] DB FLAVOR :POSTGRES
2026-09-28 20:15:49,703 [I] --------- Verifying Ranger DB connection ---------
2026-09-28 20:15:49,703 [I] Checking connection..
2026-09-28 20:15:49,703 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-28 20:15:49,968 [I] Checking connection passed.
2026-09-28 20:15:49,968 [I] --------- Verifying version history table ---------
2026-09-28 20:15:49,969 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 20:15:50,216 [I] Table x_db_version_h does not exist in database ranger
2026-09-28 20:15:50,216 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 20:15:50,462 [I] Table x_db_version_h does not exist in database ranger
2026-09-28 20:15:50,463 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-28 20:15:50,463 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-28 20:15:50.731 UTC [3751] WARNING: there is no transaction in progress
2026-09-28 20:15:50,738 [I] create_dbversion_catalog.sql file imported successfully
2026-09-28 20:15:50,738 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 20:15:51,001 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-28 20:15:51,002 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 20:15:51,002 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-28 20:15:51,239 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-28 20:15:51,496 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-n45k.c.gcp-upstream.internal','N') ;"
2026-09-28 20:15:51,732 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 20:15:51,993 [I] Table x_portal_user does not exist in database ranger
2026-09-28 20:15:51,994 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 20:15:52,230 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-28 20:15:52,231 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 20:15:52,490 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 20:15:52,735 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-28 20:15:52,735 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-28 20:15:53.723 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.741 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.771 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.789 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.806 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.825 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.887 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.894 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.909 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.920 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.932 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.946 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.958 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.965 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.972 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:53.979 UTC [3859] WARNING: there is no transaction in progress
2026-09-28 20:15:54,666 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-28 20:15:54,667 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-28 20:15:54,890 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-28 20:15:54,891 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 20:15:55,157 [I] Table x_portal_user already exists in database 'ranger'
2026-09-28 20:15:55,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 20:15:55,417 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-28 20:15:55,417 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 20:15:55,679 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 20:15:55,928 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-n45k.c.gcp-upstream.internal';"
2026-09-28 20:15:56,157 [I] CORE_DB_SCHEMA import status has been updated
2026-09-28 20:15:56,157 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-28 20:15:56,388 [I] DB_PATCHES have already been applied
I20260928 20:15:56.393841 25336 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJmbe_f/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260928 20:15:56.393913 25336 mini_ranger.cc:193] Using host: 127.24.190.20
I20260928 20:15:56.396994 25336 mini_ranger.cc:227] Ranger admin URL: http://127.24.190.20:50021
Sep 28, 2026 8:15:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 8:15:56 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 8:15:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp
Sep 28, 2026 8:15:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 28, 2026 8:15:56 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 28, 2026 8:15:57 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp].
Sep 28, 2026 8:15:57 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260928 20:15:57.502650 25336 mini_ranger.cc:160] Time spent starting Ranger: real 8.640s user 0.000s sys 0.008s
Sep 28, 2026 8:16:17 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 28, 2026 8:16:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.XKeyREST
Sep 28, 2026 8:16:17 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 28, 2026 8:16:17 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 28, 2026 8:16:18 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260928 20:16:18.862700 25336 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/rangerkms_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/rangerkms_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.190.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.190.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 28 20:16:18 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626578, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260928 20:16:18.965745 25336 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260928 20:16:18.976331 25336 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260928 20:16:19.886924 25336 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260928 20:16:19.887017 25336 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms
I20260928 20:16:19.887040 25336 mini_ranger_kms.cc:227] Using postgres at 127.24.190.20:34953
2026-09-28 20:16:20,086 [I] DB FLAVOR :POSTGRES
2026-09-28 20:16:20,086 [I] --------- Verifying Ranger DB connection ---------
2026-09-28 20:16:20,086 [I] Checking connection
2026-09-28 20:16:20,087 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-28 20:16:20,319 [I] connection success
2026-09-28 20:16:20,319 [I] --------- Verifying Ranger DB tables ---------
2026-09-28 20:16:20,319 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-28 20:16:20,319 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-28 20:16:20,557 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-28 20:16:20,557 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 20:16:20,557 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-28 20:16:20,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:34953/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-28 20:16:20,814 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260928 20:16:21.310843 25336 mini_ranger_kms.cc:310] Created kms service
I20260928 20:16:21.492581 25336 mini_ranger_kms.cc:326] Created kudu user
I20260928 20:16:21.543859 25336 mini_ranger_kms.cc:343] Created rangerkms user
Sep 28 20:16:21 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626578, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:16:21.944432 25336 mini_ranger_kms.cc:384] Added ranger policy
I20260928 20:16:21.944553 25336 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260928 20:16:21.944582 25336 mini_ranger_kms.cc:240] Using host: 127.24.190.20
I20260928 20:16:21.947844 25336 mini_ranger_kms.cc:276] Ranger KMS PID: 4039
I20260928 20:16:21.947985 25336 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.190.20:41431
Sep 28, 2026 8:16:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 8:16:22 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 8:16:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 28, 2026 8:16:22 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 28, 2026 8:16:23 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-kms/ews/webapp].
Sep 28, 2026 8:16:23 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Sep 28 20:16:24 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790626584, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.190.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:16:24.233712 25336 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.268s user 0.008s sys 0.174s
I20260928 20:16:24.233803 25336 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260928 20:16:24.233894 25336 mini_ranger_kms.cc:401] 127.24.190.20:41431/kms/v1/keys
Sep 28 20:16:24 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626584, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.190.20@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
Sep 28 20:16:24 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626584, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.190.20@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
Sep 28 20:16:27 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:16:27.177336 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39433
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:39433
--ranger_config_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:41431/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:16:27.260452 4090 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:16:27.260655 4090 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:16:27.260677 4090 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:16:27.261922 4090 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:16:27.261965 4090 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:16:27.261978 4090 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:16:27.261991 4090 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:16:27.262002 4090 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:16:27.263605 4090 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.190.20:41431/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:39433
--ranger_config_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:39433
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4090
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:16:27.263844 4090 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:16:27.264091 4090 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:16:27.269963 4095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:27.269968 4096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:16:27.270262 4090 server_base.cc:1034] running on GCE node
W20260928 20:16:27.270401 4098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:16:27.270700 4090 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:16:27.271037 4090 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:16:27.272217 4090 hybrid_clock.cc:648] HybridClock initialized: now 1790626587272186 us; error 39 us; skew 500 ppm
Sep 28 20:16:27 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626587, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:16:27.278127 4090 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:16:27.278646 4090 webserver.cc:460] Webserver started at http://127.24.190.62:40843/ using document root <none> and password file <none>
I20260928 20:16:27.278887 4090 fs_manager.cc:359] Metadata directory not provided
I20260928 20:16:27.278949 4090 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:16:27.279099 4090 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:16:27 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626587, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:16:27.339385 4090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5"
format_stamp: "Formatted at 2026-09-28 20:16:27 on dist-test-slave-n45k"
server_key: "3ef14069872206c16c58abcde09a3b6c"
server_key_iv: "22cccdd7bf390bba0ddf02faf59bb15b"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:27.339779 4090 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5"
format_stamp: "Formatted at 2026-09-28 20:16:27 on dist-test-slave-n45k"
server_key: "3ef14069872206c16c58abcde09a3b6c"
server_key_iv: "22cccdd7bf390bba0ddf02faf59bb15b"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:27.341250 4090 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:16:27.355846 4105 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:27.356037 4090 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:16:27.356135 4090 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5"
format_stamp: "Formatted at 2026-09-28 20:16:27 on dist-test-slave-n45k"
server_key: "3ef14069872206c16c58abcde09a3b6c"
server_key_iv: "22cccdd7bf390bba0ddf02faf59bb15b"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:27.356251 4090 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:16:27.377978 4090 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:16:27.380110 4090 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:16:27.380268 4090 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:16:27.385841 4090 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:39433
I20260928 20:16:27.385864 4157 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:39433 every 8 connection(s)
I20260928 20:16:27.386333 4090 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:16:27.387051 4158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:16:27.389263 4158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5: Bootstrap starting.
I20260928 20:16:27.389842 4158 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5: Neither blocks nor log segments found. Creating new log.
I20260928 20:16:27.390137 4158 log.cc:824] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5: Log is configured to *not* fsync() on all Append() calls
I20260928 20:16:27.390834 4158 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5: No bootstrap required, opened a new log
I20260928 20:16:27.392858 4158 raft_consensus.cc:348] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39433 } }
I20260928 20:16:27.393481 4158 raft_consensus.cc:374] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:16:27.393525 4158 raft_consensus.cc:729] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75c2bb6f114d488e9b9f1c9aca63dcf5, State: Initialized, Role: FOLLOWER
I20260928 20:16:27.393594 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 4090
I20260928 20:16:27.393703 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:16:27.393733 4158 consensus_queue.cc:260] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39433 } }
I20260928 20:16:27.393852 4158 raft_consensus.cc:388] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:16:27.393896 4158 raft_consensus.cc:482] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:16:27.393896 25336 external_mini_cluster.cc:1428] Setting key 14db6a43ad082ceb467281e7cab01146
I20260928 20:16:27.393954 4158 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:16:27.394774 4158 raft_consensus.cc:504] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39433 } }
I20260928 20:16:27.394893 4158 leader_election.cc:302] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 75c2bb6f114d488e9b9f1c9aca63dcf5; no voters:
I20260928 20:16:27.395068 4158 leader_election.cc:288] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:16:27.395143 4163 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:16:27.395291 4163 raft_consensus.cc:686] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [term 1 LEADER]: Becoming Leader. State: Replica: 75c2bb6f114d488e9b9f1c9aca63dcf5, State: Running, Role: LEADER
I20260928 20:16:27.395359 4158 sys_catalog.cc:564] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:16:27.395396 4163 consensus_queue.cc:237] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39433 } }
I20260928 20:16:27.395717 4163 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39433 } } }
I20260928 20:16:27.395826 4163 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [sys.catalog]: This master's current role is: LEADER
I20260928 20:16:27.396234 4164 sys_catalog.cc:455] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 75c2bb6f114d488e9b9f1c9aca63dcf5. Latest consensus state: current_term: 1 leader_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "75c2bb6f114d488e9b9f1c9aca63dcf5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 39433 } } }
I20260928 20:16:27.396384 4164 sys_catalog.cc:458] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5 [sys.catalog]: This master's current role is: LEADER
I20260928 20:16:27.396533 4170 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:16:27.397032 4170 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:16:27.397328 4158 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
Sep 28 20:16:27 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626587, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:16:27.409600 4162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:27.394426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34730 (local address 127.24.190.62:39433)
0928 20:16:27.394619 (+ 193us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:27.394630 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:27.394662 (+ 32us) server_negotiation.cc:407] Connection header received
0928 20:16:27.394803 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:27.394810 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:27.394868 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:27.395018 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:16:27.395989 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:27.397546 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:27.399567 (+ 2021us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:27.400967 (+ 1400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:27.401106 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:27.404224 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:16:27.404229 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:16:27.404229 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:16:27.404241 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:16:27.407358 (+ 3117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:27.408209 (+ 851us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:27.408212 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:27.408212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:27.408327 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:27.408547 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:27.408547 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:27.408548 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:27.408881 (+ 333us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:16:27.409053 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:27.409181 (+ 128us) server_negotiation.cc:299] Negotiation successful
0928 20:16:27.409317 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":87,"threads_started":1}
I20260928 20:16:27.410650 4170 catalog_manager.cc:1347] Generated new cluster ID: 72b8799a0bb341f7a66198a86d6f4a1a
I20260928 20:16:27.410718 4170 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:16:27.419008 4170 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:16:27.419832 4170 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:16:27.423794 4170 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5: Generated new TSK 0
I20260928 20:16:27.424037 4170 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:16:28.185597 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:41431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39433
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:16:28.303475 4204 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:16:28.303736 4204 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:16:28.303778 4204 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:16:28.305485 4204 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:16:28.305549 4204 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:16:28.305590 4204 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:16:28.307883 4204 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.190.20:41431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4204
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:16:28.308137 4204 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:16:28.308394 4204 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:16:28.315567 4209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:28.315657 4210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:28.315785 4212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:16:28.316690 4204 server_base.cc:1034] running on GCE node
I20260928 20:16:28.316919 4204 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:16:28.317202 4204 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:16:28.320601 4204 hybrid_clock.cc:648] HybridClock initialized: now 1790626588321074 us; error 537 us; skew 500 ppm
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:16:28.323732 4204 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:16:28.324352 4204 webserver.cc:460] Webserver started at http://127.24.190.1:36941/ using document root <none> and password file <none>
I20260928 20:16:28.324676 4204 fs_manager.cc:359] Metadata directory not provided
I20260928 20:16:28.324759 4204 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:16:28.324904 4204 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:16:28.339598 4204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "9998fbf93f454046bd74828f3e190987"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "3fe4ae98fe3ae8bc9ec42a28ca6fc9f5"
server_key_iv: "e3eab872f3a46617e00722059d426b27"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.340044 4204 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "9998fbf93f454046bd74828f3e190987"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "3fe4ae98fe3ae8bc9ec42a28ca6fc9f5"
server_key_iv: "e3eab872f3a46617e00722059d426b27"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.347693 4204 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.000s sys 0.002s
I20260928 20:16:28.370524 4221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.370740 4204 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.000s sys 0.000s
I20260928 20:16:28.370863 4204 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "9998fbf93f454046bd74828f3e190987"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "3fe4ae98fe3ae8bc9ec42a28ca6fc9f5"
server_key_iv: "e3eab872f3a46617e00722059d426b27"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.370967 4204 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:16:28.390359 4204 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:16:28.392428 4204 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:16:28.392599 4204 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:16:28.392882 4204 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:16:28.393257 4204 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:16:28.393312 4204 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.393352 4204 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:16:28.393374 4204 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.401366 4204 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:37803
I20260928 20:16:28.401458 4334 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:37803 every 8 connection(s)
I20260928 20:16:28.401790 4204 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:16:28.402935 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 4204
I20260928 20:16:28.403046 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:16:28.403237 25336 external_mini_cluster.cc:1428] Setting key 15ce84b2d410c296b4ee0002e045e3df
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:16:28.411725 4337 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.402536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39433 (local address 127.24.190.1:60143)
0928 20:16:28.402758 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:28.402804 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:28.403465 (+ 661us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:28.403857 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:28.403861 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:28.404049 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:16:28.404240 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.404251 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.404980 (+ 729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.404981 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.405882 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.405884 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.406308 (+ 424us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.406309 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.406451 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.407030 (+ 579us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:16:28.407038 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:16:28.408305 (+ 1267us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:16:28.410023 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:16:28.410030 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:16:28.410032 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:16:28.410259 (+ 227us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:16:28.410538 (+ 279us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:16:28.410539 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:16:28.410539 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:16:28.410664 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:16:28.410987 (+ 323us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:16:28.410994 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:16:28.411167 (+ 173us) client_negotiation.cc:769] Sending connection context
0928 20:16:28.411272 (+ 105us) client_negotiation.cc:240] Negotiation successful
0928 20:16:28.411441 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":75,"threads_started":1}
I20260928 20:16:28.412206 4338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.402608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:60143 (local address 127.24.190.62:39433)
0928 20:16:28.403641 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.403643 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.403650 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:16:28.403670 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.403671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.403681 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.403777 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:16:28.404347 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.404883 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.405992 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.406204 (+ 212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.406280 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.408404 (+ 2124us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:16:28.408406 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:16:28.408406 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:16:28.408414 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:16:28.409917 (+ 1503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.410403 (+ 486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.410404 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.410405 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.410470 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.410732 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.410734 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.410734 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.410897 (+ 163us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:16:28.410959 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.411979 (+ 1020us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.412071 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1006,"thread_start_us":72,"threads_started":1}
I20260928 20:16:28.412573 4335 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39433
I20260928 20:16:28.412672 4335 heartbeater.cc:464] Registering TS with master...
I20260928 20:16:28.412881 4335 heartbeater.cc:511] Master 127.24.190.62:39433 requested a full tablet report, sending...
I20260928 20:16:28.413404 4122 ts_manager.cc:194] Registered new tserver with Master: 9998fbf93f454046bd74828f3e190987 (127.24.190.1:37803)
I20260928 20:16:28.413985 4122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:60143
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:16:28.444870 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:41431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39433
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260928 20:16:28.544726 4343 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:16:28.545027 4343 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:16:28.545066 4343 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:16:28.546895 4343 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:16:28.546958 4343 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:16:28.546999 4343 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:16:28.548975 4343 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.190.20:41431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4343
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:16:28.549268 4343 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:16:28.549515 4343 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:16:28.556156 4348 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:28.556434 4351 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:28.556959 4349 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:16:28.557189 4343 server_base.cc:1034] running on GCE node
I20260928 20:16:28.557403 4343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:16:28.557688 4343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:16:28.558876 4343 hybrid_clock.cc:648] HybridClock initialized: now 1790626588558853 us; error 40 us; skew 500 ppm
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:16:28.561715 4343 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:16:28.562265 4343 webserver.cc:460] Webserver started at http://127.24.190.2:41055/ using document root <none> and password file <none>
I20260928 20:16:28.562517 4343 fs_manager.cc:359] Metadata directory not provided
I20260928 20:16:28.562589 4343 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:16:28.562732 4343 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:16:28.577199 4343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "4a0bb117af7d44cbab7cd0a8e670fb40"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "a23080da2ffb6679a57b2a00fb6aea2a"
server_key_iv: "095f632336b452b5337c3b57c7d05efe"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.577662 4343 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "4a0bb117af7d44cbab7cd0a8e670fb40"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "a23080da2ffb6679a57b2a00fb6aea2a"
server_key_iv: "095f632336b452b5337c3b57c7d05efe"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.579439 4343 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.003s sys 0.001s
I20260928 20:16:28.593014 4358 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.593196 4343 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:16:28.593295 4343 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "4a0bb117af7d44cbab7cd0a8e670fb40"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "a23080da2ffb6679a57b2a00fb6aea2a"
server_key_iv: "095f632336b452b5337c3b57c7d05efe"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.593415 4343 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:16:28.613298 4343 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:16:28.615871 4343 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:16:28.616070 4343 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:16:28.616341 4343 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:16:28.616714 4343 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:16:28.616761 4343 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.616791 4343 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:16:28.616828 4343 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.624053 4343 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:34277
I20260928 20:16:28.624480 4343 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:16:28.624995 4472 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:34277 every 8 connection(s)
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:16:28.634480 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 4343
I20260928 20:16:28.634601 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:16:28.634805 25336 external_mini_cluster.cc:1428] Setting key 881aaaf005d14c538f51002ad140c000
I20260928 20:16:28.636790 4338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.626011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:57707 (local address 127.24.190.62:39433)
0928 20:16:28.626125 (+ 114us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.626127 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.626255 (+ 128us) server_negotiation.cc:407] Connection header received
0928 20:16:28.626980 (+ 725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.626981 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.626992 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.627055 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:16:28.627819 (+ 764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.628523 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.629960 (+ 1437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.630217 (+ 257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.630355 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.633298 (+ 2943us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:16:28.633300 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:16:28.633300 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:16:28.633308 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:16:28.635189 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.635690 (+ 501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.635691 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.635692 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.635752 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.636037 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.636038 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.636038 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.636183 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:16:28.636229 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.636603 (+ 374us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.636694 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260928 20:16:28.637302 4475 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.625692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39433 (local address 127.24.190.2:57707)
0928 20:16:28.626127 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:28.626172 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:28.626861 (+ 689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:28.627135 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:28.627139 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:28.627384 (+ 245us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:16:28.627721 (+ 337us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.627727 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.628622 (+ 895us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.628623 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.629871 (+ 1248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.629874 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.630345 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.630346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.630488 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.631137 (+ 649us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:16:28.631147 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:16:28.632820 (+ 1673us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:16:28.635274 (+ 2454us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:16:28.635281 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:16:28.635284 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:16:28.635595 (+ 311us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:16:28.635823 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:16:28.635824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:16:28.635824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:16:28.635962 (+ 138us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:16:28.636278 (+ 316us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:16:28.636285 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:16:28.636447 (+ 162us) client_negotiation.cc:769] Sending connection context
0928 20:16:28.636909 (+ 462us) client_negotiation.cc:240] Negotiation successful
0928 20:16:28.637065 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":396,"thread_start_us":82,"threads_started":1}
I20260928 20:16:28.638348 4473 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39433
I20260928 20:16:28.638454 4473 heartbeater.cc:464] Registering TS with master...
I20260928 20:16:28.638649 4473 heartbeater.cc:511] Master 127.24.190.62:39433 requested a full tablet report, sending...
I20260928 20:16:28.638994 4122 ts_manager.cc:194] Registered new tserver with Master: 4a0bb117af7d44cbab7cd0a8e670fb40 (127.24.190.2:34277)
I20260928 20:16:28.639505 4122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:57707
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:16:28.665689 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:41431/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39433
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44655
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:16:28.765475 4478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:16:28.765805 4478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:16:28.765846 4478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:16:28.767705 4478 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:16:28.767848 4478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:16:28.767938 4478 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:16:28.770203 4478 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44655
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.190.20:41431/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:39433
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.4478
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:16:28.770691 4478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:16:28.771014 4478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:16:28.779135 4486 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:28.779553 4484 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:16:28.779752 4483 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:16:28.781047 4478 server_base.cc:1034] running on GCE node
I20260928 20:16:28.781296 4478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:16:28.781576 4478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:16:28.782708 4478 hybrid_clock.cc:648] HybridClock initialized: now 1790626588782680 us; error 45 us; skew 500 ppm
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:16:28.785971 4478 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:16:28.786518 4478 webserver.cc:460] Webserver started at http://127.24.190.3:43729/ using document root <none> and password file <none>
I20260928 20:16:28.786783 4478 fs_manager.cc:359] Metadata directory not provided
I20260928 20:16:28.786849 4478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:16:28.787070 4478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:16:28.800917 4478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "505854858c6d4ec4b0fd064dca2b6840"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "56a8576bf9a64eb9646c108ba41debc7"
server_key_iv: "73c3705621ad3ef976f9bd63f16cbfbb"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.801484 4478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "505854858c6d4ec4b0fd064dca2b6840"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "56a8576bf9a64eb9646c108ba41debc7"
server_key_iv: "73c3705621ad3ef976f9bd63f16cbfbb"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.803697 4478 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260928 20:16:28.818449 4493 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.818720 4478 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260928 20:16:28.818800 4478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "505854858c6d4ec4b0fd064dca2b6840"
format_stamp: "Formatted at 2026-09-28 20:16:28 on dist-test-slave-n45k"
server_key: "56a8576bf9a64eb9646c108ba41debc7"
server_key_iv: "73c3705621ad3ef976f9bd63f16cbfbb"
server_key_version: "kuduclusterkey@0"
I20260928 20:16:28.818897 4478 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:16:28.858731 4478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:16:28.861552 4478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:16:28.861858 4478 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:16:28.862120 4478 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:16:28.862537 4478 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:16:28.862622 4478 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.862674 4478 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:16:28.862696 4478 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:16:28.871348 4478 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:46081
I20260928 20:16:28.871789 4478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:16:28.873544 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 4478
I20260928 20:16:28.873667 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:16:28.873651 4606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:46081 every 8 connection(s)
I20260928 20:16:28.873890 25336 external_mini_cluster.cc:1428] Setting key 7c827d41d38c64934e463aa18e37c1ed
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:16:28.883504 4338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.874061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:46739 (local address 127.24.190.62:39433)
0928 20:16:28.874149 (+ 88us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.874151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.874162 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:16:28.874960 (+ 798us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.874961 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.874972 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.875003 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:16:28.875957 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.876630 (+ 673us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.877873 (+ 1243us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.878095 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.878190 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.880485 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:16:28.880487 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:16:28.880487 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:16:28.880494 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:16:28.882015 (+ 1521us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.882517 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.882519 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.882519 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.882577 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.882859 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.882860 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.882860 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.882972 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:16:28.883045 (+ 73us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.883325 (+ 280us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.883414 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260928 20:16:28.883713 4609 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.872827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:39433 (local address 127.24.190.3:46739)
0928 20:16:28.873895 (+ 1068us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:28.873941 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:28.874850 (+ 909us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:28.875300 (+ 450us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:28.875305 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:28.875560 (+ 255us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:16:28.875847 (+ 287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.875853 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.876724 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.876725 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.877777 (+ 1052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.877779 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.878200 (+ 421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.878202 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.878380 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.878944 (+ 564us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:16:28.878953 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:16:28.880396 (+ 1443us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:16:28.882117 (+ 1721us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:16:28.882124 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:16:28.882126 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:16:28.882431 (+ 305us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:16:28.882652 (+ 221us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:16:28.882653 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:16:28.882654 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:16:28.882803 (+ 149us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:16:28.883048 (+ 245us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:16:28.883055 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:16:28.883191 (+ 136us) client_negotiation.cc:769] Sending connection context
0928 20:16:28.883291 (+ 100us) client_negotiation.cc:240] Negotiation successful
0928 20:16:28.883434 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1025,"thread_start_us":512,"threads_started":1}
I20260928 20:16:28.884310 4607 heartbeater.cc:347] Connected to a master server at 127.24.190.62:39433
I20260928 20:16:28.884423 4607 heartbeater.cc:464] Registering TS with master...
I20260928 20:16:28.884596 4607 heartbeater.cc:511] Master 127.24.190.62:39433 requested a full tablet report, sending...
I20260928 20:16:28.884956 4122 ts_manager.cc:194] Registered new tserver with Master: 505854858c6d4ec4b0fd064dca2b6840 (127.24.190.3:46081)
I20260928 20:16:28.885335 4122 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:46739
I20260928 20:16:28.886348 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:16:28.894591 4338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.887809 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34732 (local address 127.24.190.62:39433)
0928 20:16:28.887843 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.887845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.887955 (+ 110us) server_negotiation.cc:407] Connection header received
0928 20:16:28.888044 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.888044 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.888053 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.888081 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:16:28.888856 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.889476 (+ 620us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.890319 (+ 843us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.890527 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.890613 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.891879 (+ 1266us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:16:28.891880 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:16:28.891881 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:16:28.891888 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:16:28.893282 (+ 1394us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.893705 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.893706 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.893707 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.893763 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:16:28.893967 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:16:28.893968 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:16:28.893968 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:16:28.894095 (+ 127us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:16:28.894164 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.894421 (+ 257us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.894504 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:16:28.897105 4122 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34732:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:16:28.899436 4122 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:16:28.908399 4621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.902557 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:46081 (local address 127.0.0.1:53608)
0928 20:16:28.903912 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:28.903920 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:28.903968 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:28.904271 (+ 303us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:28.904275 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:28.904277 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:16:28.904349 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.904351 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.905621 (+ 1270us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.905622 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.906951 (+ 1329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.906954 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.908045 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.908046 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.908128 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.908143 (+ 15us) client_negotiation.cc:769] Sending connection context
0928 20:16:28.908246 (+ 103us) client_negotiation.cc:240] Negotiation successful
0928 20:16:28.908310 (+ 64us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1343,"thread_start_us":62,"threads_started":1}
I20260928 20:16:28.908948 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.903092 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53608 (local address 127.24.190.3:46081)
0928 20:16:28.903283 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.903288 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.903995 (+ 707us) server_negotiation.cc:407] Connection header received
0928 20:16:28.904047 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.904050 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.904068 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.904165 (+ 97us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:16:28.904438 (+ 273us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.905523 (+ 1085us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.907074 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.907850 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.907922 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.908007 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.908820 (+ 813us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.908864 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":87,"threads_started":1}
I20260928 20:16:28.909785 4619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.902720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:34277 (local address 127.0.0.1:48520)
0928 20:16:28.904041 (+ 1321us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:28.904049 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:28.904085 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:28.904351 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:28.904352 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:28.904354 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:16:28.904399 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.904401 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.907087 (+ 2686us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.907089 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.908474 (+ 1385us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.908476 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.909536 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.909537 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.909599 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.909603 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:16:28.909668 (+ 65us) client_negotiation.cc:240] Negotiation successful
0928 20:16:28.909707 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1305,"thread_start_us":57,"threads_started":1}
I20260928 20:16:28.909946 4539 tablet_service.cc:1467] Processing CreateTablet for tablet 4d7f94b62e8e4deeae552578a32daf3b (DEFAULT_TABLE table=test-table [id=25ac178170b746f6b9e771f14808a18d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:16:28.910312 4624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.903261 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48520 (local address 127.24.190.2:34277)
0928 20:16:28.903407 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.903411 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.904138 (+ 727us) server_negotiation.cc:407] Connection header received
0928 20:16:28.904182 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.904184 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.904199 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.904276 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:16:28.904469 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.906986 (+ 2517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.908584 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.909355 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.909425 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.909499 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.910111 (+ 612us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.910206 (+ 95us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":72,"threads_started":1}
I20260928 20:16:28.910372 4539 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d7f94b62e8e4deeae552578a32daf3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:16:28.911164 4407 tablet_service.cc:1467] Processing CreateTablet for tablet 4d7f94b62e8e4deeae552578a32daf3b (DEFAULT_TABLE table=test-table [id=25ac178170b746f6b9e771f14808a18d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:16:28.911501 4407 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d7f94b62e8e4deeae552578a32daf3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:16:28.914557 4625 tablet_bootstrap.cc:492] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Bootstrap starting.
I20260928 20:16:28.915536 4625 tablet_bootstrap.cc:654] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Neither blocks nor log segments found. Creating new log.
I20260928 20:16:28.915853 4625 log.cc:824] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Log is configured to *not* fsync() on all Append() calls
I20260928 20:16:28.916601 4625 tablet_bootstrap.cc:492] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: No bootstrap required, opened a new log
I20260928 20:16:28.916684 4625 ts_tablet_manager.cc:1397] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:16:28.918673 4625 raft_consensus.cc:348] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:28.918848 4625 raft_consensus.cc:374] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:16:28.918886 4625 raft_consensus.cc:729] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 505854858c6d4ec4b0fd064dca2b6840, State: Initialized, Role: FOLLOWER
I20260928 20:16:28.918996 4625 consensus_queue.cc:260] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:28.919263 4625 ts_tablet_manager.cc:1428] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:16:28.919412 4607 heartbeater.cc:503] Master 127.24.190.62:39433 was elected leader, sending a full tablet report...
I20260928 20:16:28.919929 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.902301 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37803 (local address 127.0.0.1:35054)
0928 20:16:28.903711 (+ 1410us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:28.903752 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:28.903813 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:28.915253 (+ 11440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:28.915254 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:28.915256 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:16:28.915306 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.915308 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.916874 (+ 1566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.916875 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.917951 (+ 1076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:28.917955 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.919699 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.919700 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:28.919765 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.919770 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:16:28.919804 (+ 34us) client_negotiation.cc:240] Negotiation successful
0928 20:16:28.919851 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1378,"thread_start_us":80,"threads_started":1}
I20260928 20:16:28.920495 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:28.902395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35054 (local address 127.24.190.1:37803)
0928 20:16:28.911579 (+ 9184us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:28.911585 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:28.911598 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:16:28.911642 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:28.911644 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:28.911661 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:28.911752 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:16:28.915403 (+ 3651us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.916632 (+ 1229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.918060 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:28.919579 (+ 1519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:28.920278 (+ 699us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:28.920348 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:28.920377 (+ 29us) server_negotiation.cc:299] Negotiation successful
0928 20:16:28.920418 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9144,"thread_start_us":43,"threads_started":1}
I20260928 20:16:28.921241 4255 tablet_service.cc:1467] Processing CreateTablet for tablet 4d7f94b62e8e4deeae552578a32daf3b (DEFAULT_TABLE table=test-table [id=25ac178170b746f6b9e771f14808a18d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:16:28.921579 4255 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d7f94b62e8e4deeae552578a32daf3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:16:28.925642 4626 tablet_bootstrap.cc:492] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Bootstrap starting.
I20260928 20:16:28.926764 4626 tablet_bootstrap.cc:654] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Neither blocks nor log segments found. Creating new log.
I20260928 20:16:28.926949 4629 tablet_bootstrap.cc:492] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: Bootstrap starting.
I20260928 20:16:28.928045 4629 tablet_bootstrap.cc:654] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: Neither blocks nor log segments found. Creating new log.
I20260928 20:16:28.928414 4626 log.cc:824] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Log is configured to *not* fsync() on all Append() calls
I20260928 20:16:28.928776 4629 log.cc:824] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: Log is configured to *not* fsync() on all Append() calls
I20260928 20:16:28.929965 4626 tablet_bootstrap.cc:492] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: No bootstrap required, opened a new log
I20260928 20:16:28.930086 4626 ts_tablet_manager.cc:1397] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.002s
I20260928 20:16:28.932592 4626 raft_consensus.cc:348] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:28.932857 4626 raft_consensus.cc:374] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:16:28.932947 4626 raft_consensus.cc:729] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a0bb117af7d44cbab7cd0a8e670fb40, State: Initialized, Role: FOLLOWER
I20260928 20:16:28.933139 4626 consensus_queue.cc:260] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:28.933521 4473 heartbeater.cc:503] Master 127.24.190.62:39433 was elected leader, sending a full tablet report...
I20260928 20:16:28.933476 4626 ts_tablet_manager.cc:1428] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 20:16:28.942868 4629 tablet_bootstrap.cc:492] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: No bootstrap required, opened a new log
I20260928 20:16:28.943032 4629 ts_tablet_manager.cc:1397] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.000s
I20260928 20:16:28.946235 4629 raft_consensus.cc:348] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:28.946554 4629 raft_consensus.cc:374] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:16:28.946668 4629 raft_consensus.cc:729] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9998fbf93f454046bd74828f3e190987, State: Initialized, Role: FOLLOWER
I20260928 20:16:28.946892 4629 consensus_queue.cc:260] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:28.947307 4629 ts_tablet_manager.cc:1428] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260928 20:16:28.947351 4335 heartbeater.cc:503] Master 127.24.190.62:39433 was elected leader, sending a full tablet report...
Sep 28 20:16:28 dist-test-slave-n45k krb5kdc[3646](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626588, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
W20260928 20:16:29.122478 4608 tablet.cc:2369] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:16:29.126406 4474 tablet.cc:2369] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:16:29.153122 4336 tablet.cc:2369] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:16:29.165017 4632 raft_consensus.cc:482] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:16:29.165177 4632 raft_consensus.cc:504] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:29.165616 4632 leader_election.cc:288] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9998fbf93f454046bd74828f3e190987 (127.24.190.1:37803), 505854858c6d4ec4b0fd064dca2b6840 (127.24.190.3:46081)
I20260928 20:16:29.169595 4623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:29.166133 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:54035 (local address 127.24.190.3:46081)
0928 20:16:29.166176 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:29.166178 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:29.166258 (+ 80us) server_negotiation.cc:407] Connection header received
0928 20:16:29.166368 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:29.166369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:29.166378 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:29.166404 (+ 26us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:16:29.166605 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.167302 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.168717 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.169235 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.169279 (+ 44us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:29.169288 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:29.169486 (+ 198us) server_negotiation.cc:299] Negotiation successful
0928 20:16:29.169526 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:16:29.169749 4620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:29.166104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38317 (local address 127.24.190.1:37803)
0928 20:16:29.166148 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:29.166151 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:29.166161 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:16:29.166191 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:29.166192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:29.166206 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:29.166300 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:16:29.166517 (+ 217us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.167279 (+ 762us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.168733 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.169339 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.169392 (+ 53us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:29.169400 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:29.169639 (+ 239us) server_negotiation.cc:299] Negotiation successful
0928 20:16:29.169680 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:16:29.170010 4634 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:29.165801 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37803 (local address 127.24.190.2:38317)
0928 20:16:29.165962 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:29.165972 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:29.166022 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:29.166359 (+ 337us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:29.166360 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:29.166362 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:16:29.166434 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:29.166436 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.167388 (+ 952us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.167388 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:29.168622 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:29.168625 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.169462 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.169462 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:29.169549 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:29.169553 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:16:29.169878 (+ 325us) client_negotiation.cc:240] Negotiation successful
0928 20:16:29.169924 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":54,"threads_started":1}
I20260928 20:16:29.170305 4635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:29.165926 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:46081 (local address 127.24.190.2:54035)
0928 20:16:29.166211 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:29.166219 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:16:29.166297 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:16:29.166471 (+ 174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:16:29.166472 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:16:29.166474 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:16:29.166540 (+ 66us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:29.166542 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.167415 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.167416 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:29.168593 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:16:29.168596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.169343 (+ 747us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.169344 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:16:29.169409 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:29.169412 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:16:29.169978 (+ 566us) client_negotiation.cc:240] Negotiation successful
0928 20:16:29.170022 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":274,"thread_start_us":66,"threads_started":1}
I20260928 20:16:29.170472 4278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d7f94b62e8e4deeae552578a32daf3b" candidate_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9998fbf93f454046bd74828f3e190987" is_pre_election: true
I20260928 20:16:29.170696 4278 raft_consensus.cc:2454] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0bb117af7d44cbab7cd0a8e670fb40 in term 0.
I20260928 20:16:29.170886 4553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d7f94b62e8e4deeae552578a32daf3b" candidate_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505854858c6d4ec4b0fd064dca2b6840" is_pre_election: true
I20260928 20:16:29.171038 4553 raft_consensus.cc:2454] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a0bb117af7d44cbab7cd0a8e670fb40 in term 0.
I20260928 20:16:29.171280 4362 leader_election.cc:302] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0bb117af7d44cbab7cd0a8e670fb40, 505854858c6d4ec4b0fd064dca2b6840; no voters:
I20260928 20:16:29.171449 4632 raft_consensus.cc:2781] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:16:29.171511 4632 raft_consensus.cc:482] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:16:29.171532 4632 raft_consensus.cc:3037] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:16:29.172394 4632 raft_consensus.cc:504] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:29.172524 4632 leader_election.cc:288] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [CANDIDATE]: Term 1 election: Requested vote from peers 9998fbf93f454046bd74828f3e190987 (127.24.190.1:37803), 505854858c6d4ec4b0fd064dca2b6840 (127.24.190.3:46081)
I20260928 20:16:29.172696 4278 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d7f94b62e8e4deeae552578a32daf3b" candidate_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9998fbf93f454046bd74828f3e190987"
I20260928 20:16:29.172737 4553 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d7f94b62e8e4deeae552578a32daf3b" candidate_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "505854858c6d4ec4b0fd064dca2b6840"
I20260928 20:16:29.172755 4278 raft_consensus.cc:3037] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:16:29.172873 4553 raft_consensus.cc:3037] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:16:29.173542 4278 raft_consensus.cc:2454] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0bb117af7d44cbab7cd0a8e670fb40 in term 1.
I20260928 20:16:29.173751 4359 leader_election.cc:302] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a0bb117af7d44cbab7cd0a8e670fb40, 9998fbf93f454046bd74828f3e190987; no voters:
I20260928 20:16:29.173820 4632 raft_consensus.cc:2781] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:16:29.173848 4553 raft_consensus.cc:2454] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a0bb117af7d44cbab7cd0a8e670fb40 in term 1.
I20260928 20:16:29.173954 4632 raft_consensus.cc:686] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 1 LEADER]: Becoming Leader. State: Replica: 4a0bb117af7d44cbab7cd0a8e670fb40, State: Running, Role: LEADER
I20260928 20:16:29.174031 4632 consensus_queue.cc:237] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } }
I20260928 20:16:29.175325 4122 catalog_manager.cc:5495] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4a0bb117af7d44cbab7cd0a8e670fb40 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4a0bb117af7d44cbab7cd0a8e670fb40" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34277 } health_report { overall_health: HEALTHY } } }
I20260928 20:16:29.200743 4624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:29.197608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48536 (local address 127.24.190.2:34277)
0928 20:16:29.197654 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:16:29.197656 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:16:29.197666 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:16:29.197718 (+ 52us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:16:29.197720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:16:29.197742 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:16:29.197839 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:16:29.197993 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.198744 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.199809 (+ 1065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:16:29.200124 (+ 315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:16:29.200201 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:16:29.200364 (+ 163us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:16:29.200494 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:16:29.200580 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0928 20:16:29.200608 (+ 28us) server_negotiation.cc:299] Negotiation successful
0928 20:16:29.200631 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:16:29.202728 4553 raft_consensus.cc:1261] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 1 FOLLOWER]: Refusing update from remote peer 4a0bb117af7d44cbab7cd0a8e670fb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:16:29.202761 4278 raft_consensus.cc:1261] T 4d7f94b62e8e4deeae552578a32daf3b P 9998fbf93f454046bd74828f3e190987 [term 1 FOLLOWER]: Refusing update from remote peer 4a0bb117af7d44cbab7cd0a8e670fb40: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:16:29.203059 4632 consensus_queue.cc:1035] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9998fbf93f454046bd74828f3e190987" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 37803 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:16:29.203227 4636 consensus_queue.cc:1035] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [LEADER]: Connected to new peer: Peer: permanent_uuid: "505854858c6d4ec4b0fd064dca2b6840" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46081 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:16:29.205695 4639 mvcc.cc:205] Tried to move back new op lower bound from 7334406509371785216 to 7334406509257375744. Current Snapshot: MvccSnapshot[applied={T|T < 7334406509371785216}]
I20260928 20:16:29.208019 4641 mvcc.cc:205] Tried to move back new op lower bound from 7334406509371785216 to 7334406509257375744. Current Snapshot: MvccSnapshot[applied={T|T < 7334406509371785216}]
I20260928 20:16:29.208812 4640 mvcc.cc:205] Tried to move back new op lower bound from 7334406509371785216 to 7334406509257375744. Current Snapshot: MvccSnapshot[applied={T|T < 7334406509371785216}]
I20260928 20:16:29.208971 4122 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:16:29.209062 4122 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:34732:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:16:29.209693 4122 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 75c2bb6f114d488e9b9f1c9aca63dcf5: Sending DeleteTablet for 3 replicas of tablet 4d7f94b62e8e4deeae552578a32daf3b
I20260928 20:16:29.210090 4539 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d7f94b62e8e4deeae552578a32daf3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:16:29 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:53608
I20260928 20:16:29.210321 4407 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d7f94b62e8e4deeae552578a32daf3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:16:29 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48520
I20260928 20:16:29.210819 4255 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d7f94b62e8e4deeae552578a32daf3b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:16:29 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:35054
I20260928 20:16:29.211292 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 4204
I20260928 20:16:29.215183 4649 tablet_replica.cc:330] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: stopping tablet replica
I20260928 20:16:29.219095 4648 tablet_replica.cc:330] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: stopping tablet replica
I20260928 20:16:29.219321 4649 raft_consensus.cc:2229] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:16:29.219496 4648 raft_consensus.cc:2229] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:16:29.219717 4649 raft_consensus.cc:2258] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:16:29.219879 4648 raft_consensus.cc:2258] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:16:29.220527 4648 ts_tablet_manager.cc:1905] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:16:29.220966 4649 ts_tablet_manager.cc:1905] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:16:29.224210 4648 ts_tablet_manager.cc:1918] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:16:29.224363 4648 log.cc:1196] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/4d7f94b62e8e4deeae552578a32daf3b
I20260928 20:16:29.225008 4648 ts_tablet_manager.cc:1939] T 4d7f94b62e8e4deeae552578a32daf3b P 505854858c6d4ec4b0fd064dca2b6840: Deleting consensus metadata
I20260928 20:16:29.225123 4649 ts_tablet_manager.cc:1918] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:16:29.225241 4649 log.cc:1196] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/4d7f94b62e8e4deeae552578a32daf3b
I20260928 20:16:29.225534 4649 ts_tablet_manager.cc:1939] T 4d7f94b62e8e4deeae552578a32daf3b P 4a0bb117af7d44cbab7cd0a8e670fb40: Deleting consensus metadata
I20260928 20:16:29.226020 4109 catalog_manager.cc:4841] TS 4a0bb117af7d44cbab7cd0a8e670fb40 (127.24.190.2:34277): tablet 4d7f94b62e8e4deeae552578a32daf3b (table test-table [id=25ac178170b746f6b9e771f14808a18d]) successfully deleted
I20260928 20:16:29.226554 4109 catalog_manager.cc:4841] TS 505854858c6d4ec4b0fd064dca2b6840 (127.24.190.3:46081): tablet 4d7f94b62e8e4deeae552578a32daf3b (table test-table [id=25ac178170b746f6b9e771f14808a18d]) successfully deleted
W20260928 20:16:29.226912 4106 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:37803 (error 108)
I20260928 20:16:29.227501 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 4343
I20260928 20:16:29.230100 4622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:16:29.229967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:37803 (local address 127.0.0.1:35062)
0928 20:16:29.230022 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0928 20:16:29.230067 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:37803: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260928 20:16:29.230245 4106 catalog_manager.cc:4584] TS 9998fbf93f454046bd74828f3e190987 (127.24.190.1:37803): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4d7f94b62e8e4deeae552578a32daf3b: Network error: Client connection negotiation failed: client connection to 127.24.190.1:37803: connect: Connection refused (error 111)
I20260928 20:16:29.234503 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 4478
I20260928 20:16:29.240314 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 4090
I20260928 20:16:29.246913 25336 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260928 20:16:29.592129 25336 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260928 20:16:29.592257 25336 mini_ranger.cc:66] Stopping Ranger...
I20260928 20:16:29.937708 25336 mini_ranger.cc:68] Stopped Ranger
2026-09-28 20:16:29.938 UTC [3676] LOG: received smart shutdown request
2026-09-28 20:16:29.941 UTC [3676] LOG: background worker "logical replication launcher" (PID 3685) exited with exit code 1
2026-09-28 20:16:29.942 UTC [3680] LOG: shutting down
2026-09-28 20:16:30.130 UTC [3676] LOG: database system is shut down
2026-09-28T20:16:30Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (46310 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:16:30 dist-test-slave-n45k krb5kdc[4660](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:16:30 dist-test-slave-n45k krb5kdc[4660](info): set up 2 sockets
Sep 28 20:16:30 dist-test-slave-n45k krb5kdc[4660](info): commencing operation
krb5kdc: starting...
W20260928 20:16:31.294745 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.031s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:16:31 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626591, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:16:31Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:16:31Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/rangeradmin_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/rangeradmin_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/rangerlookup_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/rangerlookup_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
I20260928 20:16:31.460800 25336 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskJmbe_f/build/release/bin/postgres/pg_ctl -D /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/postgres -l logfile start
2026-09-28 20:16:34.006 UTC [4690] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-09-28 20:16:34.006 UTC [4690] LOG: listening on IPv4 address "127.24.190.20", port 39955
2026-09-28 20:16:34.010 UTC [4690] LOG: listening on Unix socket "/tmp/.s.PGSQL.39955"
2026-09-28 20:16:34.045 UTC [4693] LOG: database system was shut down at 2026-09-28 20:16:32 UTC
2026-09-28 20:16:34.049 UTC [4690] LOG: database system is ready to accept connections
I20260928 20:16:35.038480 25336 mini_postgres.cc:96] Postgres bound to 39955
2026-09-28 20:16:35.044 UTC [4701] FATAL: database "slave" does not exist
127.24.190.20:39955 - accepting connections
I20260928 20:16:35.045125 25336 mini_ranger.cc:161] Starting Ranger...
I20260928 20:16:35.060359 25336 mini_ranger.cc:84] Created miniranger Postgres user
I20260928 20:16:35.580869 25336 mini_ranger.cc:87] Created ranger Postgres database
I20260928 20:16:35.580963 25336 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-admin
2026-09-28 20:16:35,875 [I] DB FLAVOR :POSTGRES
2026-09-28 20:16:35,875 [I] --------- Verifying Ranger DB connection ---------
2026-09-28 20:16:35,875 [I] Checking connection..
2026-09-28 20:16:35,876 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-09-28 20:16:36,109 [I] Checking connection passed.
2026-09-28 20:16:36,109 [I] --------- Verifying version history table ---------
2026-09-28 20:16:36,110 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 20:16:36,354 [I] Table x_db_version_h does not exist in database ranger
2026-09-28 20:16:36,355 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 20:16:36,609 [I] Table x_db_version_h does not exist in database ranger
2026-09-28 20:16:36,609 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-09-28 20:16:36,609 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-09-28 20:16:36.880 UTC [4765] WARNING: there is no transaction in progress
2026-09-28 20:16:36,887 [I] create_dbversion_catalog.sql file imported successfully
2026-09-28 20:16:36,887 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-09-28 20:16:37,133 [I] Table x_db_version_h already exists in database 'ranger'
2026-09-28 20:16:37,133 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 20:16:37,133 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-09-28 20:16:37,392 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-09-28 20:16:37,624 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-n45k.c.gcp-upstream.internal','N') ;"
2026-09-28 20:16:37,873 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 20:16:38,113 [I] Table x_portal_user does not exist in database ranger
2026-09-28 20:16:38,113 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 20:16:38,353 [I] Table x_policy_ref_group does not exist in database ranger
2026-09-28 20:16:38,353 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 20:16:38,598 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 20:16:38,847 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-09-28 20:16:38,847 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-09-28 20:16:39.852 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:39.869 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:39.886 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:39.903 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:39.924 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:39.943 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.006 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.014 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.029 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.040 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.050 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.065 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.075 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.082 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.089 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40.097 UTC [4873] WARNING: there is no transaction in progress
2026-09-28 20:16:40,787 [I] ranger_core_db_postgres.sql file imported successfully
2026-09-28 20:16:40,787 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-09-28 20:16:41,044 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-09-28 20:16:41,045 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-09-28 20:16:41,304 [I] Table x_portal_user already exists in database 'ranger'
2026-09-28 20:16:41,304 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-09-28 20:16:41,546 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-09-28 20:16:41,546 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-09-28 20:16:41,812 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-09-28 20:16:42,080 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-n45k.c.gcp-upstream.internal';"
2026-09-28 20:16:42,327 [I] CORE_DB_SCHEMA import status has been updated
2026-09-28 20:16:42,327 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-09-28 20:16:42,566 [I] DB_PATCHES have already been applied
I20260928 20:16:42.572116 25336 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-admin:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskJmbe_f/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260928 20:16:42.572192 25336 mini_ranger.cc:193] Using host: 127.24.190.20
I20260928 20:16:42.575312 25336 mini_ranger.cc:227] Ranger admin URL: http://127.24.190.20:58213
Sep 28, 2026 8:16:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 8:16:42 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 8:16:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp
Sep 28, 2026 8:16:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Sep 28, 2026 8:16:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp] .....
Sep 28, 2026 8:16:43 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-admin/ews/webapp].
Sep 28, 2026 8:16:43 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260928 20:16:43.711642 25336 mini_ranger.cc:160] Time spent starting Ranger: real 8.667s user 0.000s sys 0.009s
Sep 28, 2026 8:17:04 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Sep 28, 2026 8:17:04 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Sep 28, 2026 8:17:04 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Sep 28, 2026 8:17:04 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Sep 28, 2026 8:17:05 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260928 20:17:05.958817 25336 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.24.190.20@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.24.190.20@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/rangerkms_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.24.190.20@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/rangerkms_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.24.190.20@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.24.190.20@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
Entry for principal HTTP/127.24.190.20@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/HTTP_127.24.190.20@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Sep 28 20:17:06 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626626, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260928 20:17:06.044502 25336 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260928 20:17:06.054180 25336 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260928 20:17:07.015918 25336 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260928 20:17:07.016024 25336 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms
I20260928 20:17:07.016047 25336 mini_ranger_kms.cc:227] Using postgres at 127.24.190.20:39955
2026-09-28 20:17:07,191 [I] DB FLAVOR :POSTGRES
2026-09-28 20:17:07,192 [I] --------- Verifying Ranger DB connection ---------
2026-09-28 20:17:07,192 [I] Checking connection
2026-09-28 20:17:07,192 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-09-28 20:17:07,461 [I] connection success
2026-09-28 20:17:07,461 [I] --------- Verifying Ranger DB tables ---------
2026-09-28 20:17:07,462 [I] Verifying table ranger_masterkey in database rangerkms
2026-09-28 20:17:07,462 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-09-28 20:17:07,692 [I] Table ranger_masterkey does not exist in database rangerkms
2026-09-28 20:17:07,692 [I] --------- Importing Ranger Core DB Schema ---------
2026-09-28 20:17:07,693 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-09-28 20:17:07,693 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.24.190.20:39955/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-09-28 20:17:07,968 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260928 20:17:08.416810 25336 mini_ranger_kms.cc:310] Created kms service
I20260928 20:17:08.610363 25336 mini_ranger_kms.cc:326] Created kudu user
I20260928 20:17:08.654302 25336 mini_ranger_kms.cc:343] Created rangerkms user
Sep 28 20:17:08 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626626, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:09.021793 25336 mini_ranger_kms.cc:384] Added ranger policy
I20260928 20:17:09.021915 25336 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms:/tmp/dist-test-taskJmbe_f/build/release/bin/postgresql.jar:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskJmbe_f/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260928 20:17:09.021936 25336 mini_ranger_kms.cc:240] Using host: 127.24.190.20
I20260928 20:17:09.025633 25336 mini_ranger_kms.cc:276] Ranger KMS PID: 5053
I20260928 20:17:09.025748 25336 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.24.190.20:55679
Sep 28, 2026 8:17:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Sep 28, 2026 8:17:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Sep 28, 2026 8:17:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Sep 28, 2026 8:17:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/ews/webapp] .....
Sep 28, 2026 8:17:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-kms/ews/webapp].
Sep 28, 2026 8:17:11 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
I20260928 20:17:11.334568 25336 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 5.290s user 0.015s sys 0.139s
I20260928 20:17:11.334725 25336 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260928 20:17:11.334774 25336 mini_ranger_kms.cc:401] 127.24.190.20:55679/kms/v1/keys
Sep 28 20:17:11 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790626631, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.190.20@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Sep 28 20:17:12 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626631, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.190.20@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
Sep 28 20:17:12 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626631, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.24.190.20@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
Sep 28 20:17:14 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:17:14.868983 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41005
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41005
--ranger_config_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:14.959348 5104 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:14.959599 5104 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:14.959635 5104 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:14.960791 5104 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:14.960857 5104 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:14.960880 5104 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:14.960901 5104 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:14.960930 5104 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:14.962497 5104 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
--ranger_kms_url=127.24.190.20:55679/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41005
--ranger_config_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5104
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:14.962796 5104 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:14.963016 5104 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260928 20:17:14.968307 5104 server_base.cc:1034] running on GCE node
W20260928 20:17:14.968272 5112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:14.968266 5109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:14.968278 5110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:14.968853 5104 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:14.969138 5104 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:14.970333 5104 hybrid_clock.cc:648] HybridClock initialized: now 1790626634970315 us; error 28 us; skew 500 ppm
Sep 28 20:17:14 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626634, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:14.972694 5104 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:14.973104 5104 webserver.cc:460] Webserver started at http://127.24.190.62:44311/ using document root <none> and password file <none>
I20260928 20:17:14.973380 5104 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:14.973439 5104 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:14.973583 5104 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:17:14 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626634, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:15.033120 5104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "3c931e7cce6745958f6f9c0769ce307d"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "a09c947d70d7dc25ea67acf06013f4ab"
server_key_iv: "87926612bf03a5097c2d3c782267cc49"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:15.033625 5104 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "3c931e7cce6745958f6f9c0769ce307d"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "a09c947d70d7dc25ea67acf06013f4ab"
server_key_iv: "87926612bf03a5097c2d3c782267cc49"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:15.035597 5104 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.000s sys 0.004s
I20260928 20:17:15.049887 5119 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:15.050123 5104 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:15.050216 5104 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "3c931e7cce6745958f6f9c0769ce307d"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "a09c947d70d7dc25ea67acf06013f4ab"
server_key_iv: "87926612bf03a5097c2d3c782267cc49"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:15.050364 5104 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:15.061380 5104 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:15.063498 5104 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:15.063611 5104 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:15.068383 5104 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:41005
I20260928 20:17:15.068434 5171 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:41005 every 8 connection(s)
I20260928 20:17:15.068802 5104 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:15.069435 5172 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:15.071749 5172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Bootstrap starting.
I20260928 20:17:15.072335 5172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:15.072642 5172 log.cc:824] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:15.073380 5172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: No bootstrap required, opened a new log
I20260928 20:17:15.074944 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5104
I20260928 20:17:15.075073 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:17:15.075271 25336 external_mini_cluster.cc:1428] Setting key 8ab6be575afdf60fc04d86da4a39de81
I20260928 20:17:15.075649 5172 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:15.075884 5172 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:15.075948 5172 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c931e7cce6745958f6f9c0769ce307d, State: Initialized, Role: FOLLOWER
I20260928 20:17:15.076081 5172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:15.076159 5172 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:15.076196 5172 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:15.077075 5172 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:15.077674 5172 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:15.077816 5172 leader_election.cc:302] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c931e7cce6745958f6f9c0769ce307d; no voters:
I20260928 20:17:15.078006 5172 leader_election.cc:288] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:17:15.078027 5177 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:15.078132 5177 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 LEADER]: Becoming Leader. State: Replica: 3c931e7cce6745958f6f9c0769ce307d, State: Running, Role: LEADER
I20260928 20:17:15.078228 5177 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:15.078254 5172 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:15.078588 5178 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c931e7cce6745958f6f9c0769ce307d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } } }
I20260928 20:17:15.078740 5178 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:15.079746 5181 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:15.078605 5179 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c931e7cce6745958f6f9c0769ce307d. Latest consensus state: current_term: 1 leader_uuid: "3c931e7cce6745958f6f9c0769ce307d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } } }
I20260928 20:17:15.079874 5179 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:15.080973 5181 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:15.081305 5172 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260928 20:17:15.083082 5181 catalog_manager.cc:1347] Generated new cluster ID: 777bf2702d554c04aca9e68c009466e4
I20260928 20:17:15.083132 5181 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:17:15 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626634, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:15.087358 5176 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:15.075796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46890 (local address 127.24.190.62:41005)
0928 20:17:15.075970 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:15.075979 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:15.076013 (+ 34us) server_negotiation.cc:407] Connection header received
0928 20:17:15.076122 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:15.076129 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:15.076184 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:15.076336 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:15.077218 (+ 882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:15.078524 (+ 1306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:15.079629 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:15.080650 (+ 1021us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:15.080841 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:15.083803 (+ 2962us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:15.083814 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:15.083814 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:15.083825 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:15.085657 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:15.086060 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:15.086063 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:15.086063 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:15.086170 (+ 107us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:15.086421 (+ 251us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:15.086422 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:15.086422 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:15.086729 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:15.086885 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:15.087007 (+ 122us) server_negotiation.cc:299] Negotiation successful
0928 20:17:15.087130 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":77,"threads_started":1}
I20260928 20:17:15.113010 5181 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:17:15.113960 5181 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:15.126735 5181 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Generated new TSK 0
I20260928 20:17:15.127045 5181 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:17:15.779438 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:41005
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:15.885936 5217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:15.886178 5217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:15.886217 5217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:15.887403 5217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:15.887472 5217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:15.887517 5217 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:17:15.889701 5217 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.24.190.20:55679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:41005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5217
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:15.889955 5217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:15.890202 5217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:15.895615 5222 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:15.895623 5225 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:15.895699 5223 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:15.896086 5217 server_base.cc:1034] running on GCE node
I20260928 20:17:15.896298 5217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:15.896579 5217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:15.897748 5217 hybrid_clock.cc:648] HybridClock initialized: now 1790626635897635 us; error 125 us; skew 500 ppm
Sep 28 20:17:15 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626635, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:15.900467 5217 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:17:15.901054 5217 webserver.cc:460] Webserver started at http://127.24.190.1:43639/ using document root <none> and password file <none>
I20260928 20:17:15.901378 5217 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:15.901446 5217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:15.901587 5217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:17:15 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626635, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:15.914201 5217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "2dabc208e35c41469afbbd7e1a739fd9"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "c86531b38e490d7518ac3351811d9ab2"
server_key_iv: "c76aae7df318ae670a799e05012b3f9a"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:15.914752 5217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "2dabc208e35c41469afbbd7e1a739fd9"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "c86531b38e490d7518ac3351811d9ab2"
server_key_iv: "c76aae7df318ae670a799e05012b3f9a"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:15.918757 5217 fs_manager.cc:691] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s
I20260928 20:17:15.934489 5234 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:15.934755 5217 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260928 20:17:15.934850 5217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "2dabc208e35c41469afbbd7e1a739fd9"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "c86531b38e490d7518ac3351811d9ab2"
server_key_iv: "c76aae7df318ae670a799e05012b3f9a"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:15.934934 5217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:15.958036 5217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:15.960407 5217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:15.960578 5217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:15.960855 5217 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:15.961247 5217 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:15.961303 5217 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:15.961374 5217 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:15.961423 5217 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:15.968323 5217 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:44579
I20260928 20:17:15.968770 5217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:17:15.976173 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5217
I20260928 20:17:15.976272 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:17:15.976462 25336 external_mini_cluster.cc:1428] Setting key e24f1b99a463275f3286197bab37b098
I20260928 20:17:15.978698 5347 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:44579 every 8 connection(s)
Sep 28 20:17:15 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626635, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:17:15.996539 5352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:15.979384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41005 (local address 127.24.190.1:46065)
0928 20:17:15.980900 (+ 1516us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:15.980948 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:15.981594 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:15.986710 (+ 5116us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:15.986715 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:15.986982 (+ 267us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:15.987282 (+ 300us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:15.987289 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:15.988339 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:15.988340 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:15.989661 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:15.989664 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:15.990246 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:15.990247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:15.990432 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:15.991060 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:15.991071 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:15.992710 (+ 1639us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:15.994785 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:15.994791 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:15.994794 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:15.995087 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:15.995336 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:15.995337 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:15.995337 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:15.995491 (+ 154us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:15.995826 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:15.995832 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:15.996000 (+ 168us) client_negotiation.cc:769] Sending connection context
0928 20:17:15.996118 (+ 118us) client_negotiation.cc:240] Negotiation successful
0928 20:17:15.996296 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1465,"thread_start_us":89,"threads_started":1}
I20260928 20:17:15.996932 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:15.979386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:46065 (local address 127.24.190.62:41005)
0928 20:17:15.986413 (+ 7027us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:15.986415 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:15.986427 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:17:15.986456 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:15.986457 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:15.986470 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:15.986548 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:15.987400 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:15.988227 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:15.989762 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:15.990095 (+ 333us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:15.990159 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:15.992824 (+ 2665us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:15.992826 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:15.992826 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:15.992834 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:15.994688 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:15.995176 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:15.995177 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:15.995178 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:15.995263 (+ 85us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:15.995573 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:15.995574 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:15.995574 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:15.995730 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:15.995797 (+ 67us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:15.996704 (+ 907us) server_negotiation.cc:299] Negotiation successful
0928 20:17:15.996834 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6992,"thread_start_us":71,"threads_started":1}
I20260928 20:17:15.997329 5348 heartbeater.cc:347] Connected to a master server at 127.24.190.62:41005
I20260928 20:17:15.997470 5348 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:15.997682 5348 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:15.998359 5136 ts_manager.cc:194] Registered new tserver with Master: 2dabc208e35c41469afbbd7e1a739fd9 (127.24.190.1:44579)
I20260928 20:17:15.999349 5136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:46065
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:17:16.022382 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:41005
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260928 20:17:16.140461 5356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:16.140762 5356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:16.140796 5356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:16.142590 5356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:16.142647 5356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:16.142691 5356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:17:16.144819 5356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.24.190.20:55679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:41005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:16.145066 5356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:16.145315 5356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:16.151106 5362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:16.151233 5361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:16.151527 5356 server_base.cc:1034] running on GCE node
W20260928 20:17:16.151117 5364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:16.151911 5356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:16.152196 5356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:16.153419 5356 hybrid_clock.cc:648] HybridClock initialized: now 1790626636153401 us; error 35 us; skew 500 ppm
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:16.156658 5356 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:17:16.157202 5356 webserver.cc:460] Webserver started at http://127.24.190.2:38791/ using document root <none> and password file <none>
I20260928 20:17:16.157480 5356 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:16.157542 5356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:16.157729 5356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:16.175608 5356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "a2404b425b71428280712db2a8da3722"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "3cc26932fec9486ac92db6479c2ab623"
server_key_iv: "d0c3a301331e1248cfc7eae5552a3f2b"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.178732 5356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "a2404b425b71428280712db2a8da3722"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "3cc26932fec9486ac92db6479c2ab623"
server_key_iv: "d0c3a301331e1248cfc7eae5552a3f2b"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.180722 5356 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s
I20260928 20:17:16.201062 5372 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.202099 5356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260928 20:17:16.202301 5356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "a2404b425b71428280712db2a8da3722"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "3cc26932fec9486ac92db6479c2ab623"
server_key_iv: "d0c3a301331e1248cfc7eae5552a3f2b"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.202505 5356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:16.236245 5356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:16.239683 5356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:16.239898 5356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:16.240216 5356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:16.240624 5356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:16.240705 5356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.240768 5356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:16.240816 5356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.247175 5356 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:34125
I20260928 20:17:16.247678 5356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:17:16.252898 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5356
I20260928 20:17:16.253008 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:17:16.253144 5485 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:34125 every 8 connection(s)
I20260928 20:17:16.253206 25336 external_mini_cluster.cc:1428] Setting key 16e84318d4e36240e3079c6db6009c09
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
I20260928 20:17:16.276592 5488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:16.253738 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41005 (local address 127.24.190.2:47247)
0928 20:17:16.258841 (+ 5103us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:16.258921 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:16.259646 (+ 725us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:16.264200 (+ 4554us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:16.264205 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:16.264454 (+ 249us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:16.264756 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:16.264763 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.265844 (+ 1081us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.265845 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:16.267196 (+ 1351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:16.267200 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.267784 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.267785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:16.267935 (+ 150us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:16.268536 (+ 601us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:16.268546 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:16.272825 (+ 4279us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:16.274946 (+ 2121us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:16.274955 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:16.274958 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:16.275260 (+ 302us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:16.275470 (+ 210us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:16.275470 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:16.275471 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:16.275597 (+ 126us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:16.275891 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:16.275897 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:16.276061 (+ 164us) client_negotiation.cc:769] Sending connection context
0928 20:17:16.276169 (+ 108us) client_negotiation.cc:240] Negotiation successful
0928 20:17:16.276334 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5040,"thread_start_us":96,"threads_started":1}
I20260928 20:17:16.277155 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:16.254050 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:47247 (local address 127.24.190.62:41005)
0928 20:17:16.254108 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:16.254111 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:16.259032 (+ 4921us) server_negotiation.cc:407] Connection header received
0928 20:17:16.263904 (+ 4872us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:16.263906 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:16.263926 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:16.263962 (+ 36us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:16.264879 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.265678 (+ 799us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.267298 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.267617 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.267664 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:16.272957 (+ 5293us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:16.272959 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:16.272959 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:16.272968 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:16.274823 (+ 1855us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:16.275345 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:16.275346 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:16.275347 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:16.275405 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:16.275660 (+ 255us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:16.275661 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:16.275661 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:16.275808 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:16.275866 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:16.276966 (+ 1100us) server_negotiation.cc:299] Negotiation successful
0928 20:17:16.277060 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:17:16.277869 5486 heartbeater.cc:347] Connected to a master server at 127.24.190.62:41005
I20260928 20:17:16.277966 5486 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:16.278155 5486 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:16.278622 5136 ts_manager.cc:194] Registered new tserver with Master: a2404b425b71428280712db2a8da3722 (127.24.190.2:34125)
I20260928 20:17:16.279132 5136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:47247
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:17:16.297705 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:41005
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:16.408200 5491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:16.408555 5491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:16.408599 5491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:16.410894 5491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:16.410961 5491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:16.410996 5491 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:17:16.421715 5491 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.24.190.20:55679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:41005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:16.422315 5491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:16.424346 5491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:16.430926 5497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:16.431085 5499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:16.430926 5496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:16.432312 5491 server_base.cc:1034] running on GCE node
I20260928 20:17:16.432528 5491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:16.432803 5491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:16.436100 5491 hybrid_clock.cc:648] HybridClock initialized: now 1790626636436077 us; error 34 us; skew 500 ppm
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:16.444252 5491 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:17:16.444862 5491 webserver.cc:460] Webserver started at http://127.24.190.3:39251/ using document root <none> and password file <none>
I20260928 20:17:16.445129 5491 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:16.445185 5491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:16.445312 5491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:16.472162 5491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "6139ad5f743543ce9da63d2f8507f0d7"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "ad5765935b64fe12ea184452f7669906"
server_key_iv: "11e25cf54412b677589342ff2015af7c"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.472726 5491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "6139ad5f743543ce9da63d2f8507f0d7"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "ad5765935b64fe12ea184452f7669906"
server_key_iv: "11e25cf54412b677589342ff2015af7c"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.477945 5491 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.002s
I20260928 20:17:16.498068 5506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.498348 5491 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260928 20:17:16.498507 5491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "6139ad5f743543ce9da63d2f8507f0d7"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "ad5765935b64fe12ea184452f7669906"
server_key_iv: "11e25cf54412b677589342ff2015af7c"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.498703 5491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:16.529050 5491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:16.531695 5491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:16.531937 5491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:16.532280 5491 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:16.532716 5491 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:16.532814 5491 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.532907 5491 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:16.532968 5491 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.540472 5491 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36245
I20260928 20:17:16.540998 5491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:17:16.544071 5619 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36245 every 8 connection(s)
I20260928 20:17:16.544377 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5491
I20260928 20:17:16.544476 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:17:16.544670 25336 external_mini_cluster.cc:1428] Setting key 877d4fb9714ed438c0326e78dd4cb32c
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:16.554999 5351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:16.543674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:58291 (local address 127.24.190.62:41005)
0928 20:17:16.543734 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:16.543737 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:16.544492 (+ 755us) server_negotiation.cc:407] Connection header received
0928 20:17:16.545320 (+ 828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:16.545321 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:16.545332 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:16.545362 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:16.546211 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.546965 (+ 754us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.548499 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.548798 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.548846 (+ 48us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:16.551526 (+ 2680us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:16.551528 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:16.551528 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:16.551536 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:16.553265 (+ 1729us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:16.553842 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:16.553843 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:16.553843 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:16.553899 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:16.554158 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:16.554159 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:16.554159 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:16.554300 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:16.554364 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:16.554784 (+ 420us) server_negotiation.cc:299] Negotiation successful
0928 20:17:16.554888 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:17:16.555836 5622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:16.543348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41005 (local address 127.24.190.3:58291)
0928 20:17:16.544335 (+ 987us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:16.544377 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:16.545211 (+ 834us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:16.545553 (+ 342us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:16.545558 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:16.545826 (+ 268us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:16.546100 (+ 274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:16.546106 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.547085 (+ 979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.547086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:16.548391 (+ 1305us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:16.548394 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.548951 (+ 557us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.548952 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:16.549094 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:16.549728 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:16.549738 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:16.551410 (+ 1672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:16.553362 (+ 1952us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:16.553369 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:16.553372 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:16.553716 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:16.553968 (+ 252us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:16.553968 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:16.553969 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:16.554089 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:16.554415 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:16.554422 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:16.554599 (+ 177us) client_negotiation.cc:769] Sending connection context
0928 20:17:16.555415 (+ 816us) client_negotiation.cc:240] Negotiation successful
0928 20:17:16.555582 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":945,"thread_start_us":87,"threads_started":1}
I20260928 20:17:16.556548 5620 heartbeater.cc:347] Connected to a master server at 127.24.190.62:41005
I20260928 20:17:16.556640 5620 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:16.556838 5620 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:16.557247 5136 ts_manager.cc:194] Registered new tserver with Master: 6139ad5f743543ce9da63d2f8507f0d7 (127.24.190.3:36245)
I20260928 20:17:16.557734 5136 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:58291
I20260928 20:17:16.566977 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:17:16.567759 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5217
I20260928 20:17:16.572844 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5356
I20260928 20:17:16.578812 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5491
I20260928 20:17:16.585125 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5104
I20260928 20:17:16.595306 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41005
--webserver_interface=127.24.190.62
--webserver_port=44311
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41005
--ranger_config_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:16.677565 5623 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:16.677834 5623 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:16.677874 5623 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:16.679133 5623 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:16.679217 5623 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:16.679241 5623 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:16.679273 5623 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:16.679301 5623 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:16.681066 5623 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41005
--ranger_config_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41005
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=44311
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5623
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:16.681346 5623 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:16.681576 5623 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:16.686651 5628 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:16.686702 5629 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:16.686873 5623 server_base.cc:1034] running on GCE node
W20260928 20:17:16.686666 5631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:16.687251 5623 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:16.687582 5623 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:16.688759 5623 hybrid_clock.cc:648] HybridClock initialized: now 1790626636688739 us; error 33 us; skew 500 ppm
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:16.691813 5623 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:16.692431 5623 webserver.cc:460] Webserver started at http://127.24.190.62:44311/ using document root <none> and password file <none>
I20260928 20:17:16.692692 5623 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:16.692782 5623 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:16.738349 5623 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:16.739223 5639 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.739487 5623 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:16.739590 5623 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "3c931e7cce6745958f6f9c0769ce307d"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "a09c947d70d7dc25ea67acf06013f4ab"
server_key_iv: "87926612bf03a5097c2d3c782267cc49"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.740056 5623 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:16.758742 5623 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:16.761178 5623 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:16.761353 5623 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:16.766569 5623 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:41005
I20260928 20:17:16.766604 5691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:41005 every 8 connection(s)
I20260928 20:17:16.767277 5623 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:16.768651 5692 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:17:16.769289 5692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Bootstrap starting.
I20260928 20:17:16.771741 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5623
I20260928 20:17:16.772049 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:44579
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:41005
--webserver_port=43639
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:16.777936 5692 log.cc:824] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:16.779691 5692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:17:16.779994 5692 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Bootstrap complete.
I20260928 20:17:16.782558 5692 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:16.782806 5692 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c931e7cce6745958f6f9c0769ce307d, State: Initialized, Role: FOLLOWER
I20260928 20:17:16.783016 5692 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:16.783115 5692 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:16.783180 5692 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:16.783236 5692 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:17:16.784399 5692 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:16.784523 5692 leader_election.cc:302] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c931e7cce6745958f6f9c0769ce307d; no voters:
I20260928 20:17:16.784703 5692 leader_election.cc:288] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [CANDIDATE]: Term 2 election: Requested vote from peers
I20260928 20:17:16.784736 5696 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:17:16.784971 5696 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [term 2 LEADER]: Becoming Leader. State: Replica: 3c931e7cce6745958f6f9c0769ce307d, State: Running, Role: LEADER
I20260928 20:17:16.785066 5692 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:16.785107 5696 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } }
I20260928 20:17:16.785434 5696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3c931e7cce6745958f6f9c0769ce307d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } } }
I20260928 20:17:16.785573 5696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:16.785750 5696 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c931e7cce6745958f6f9c0769ce307d. Latest consensus state: current_term: 2 leader_uuid: "3c931e7cce6745958f6f9c0769ce307d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c931e7cce6745958f6f9c0769ce307d" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41005 } } }
I20260928 20:17:16.785862 5696 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:16.786000 5705 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:16.786633 5705 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:16.786810 5705 catalog_manager.cc:1259] Loaded cluster ID: 777bf2702d554c04aca9e68c009466e4
I20260928 20:17:16.786890 5705 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:17:16.786996 5692 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260928 20:17:16.788542 5705 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:16.788746 5705 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Loaded TSK: 0
I20260928 20:17:16.788990 5705 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 20:17:16.869071 5694 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:16.869347 5694 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:16.869385 5694 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:16.870921 5694 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:16.870996 5694 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:16.871043 5694 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:17:16.872727 5694 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:44579
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=43639
--tserver_master_addrs=127.24.190.62:41005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:16.872969 5694 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:16.873225 5694 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:16.878250 5729 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:16.878441 5730 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:16.878297 5732 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:16.879505 5694 server_base.cc:1034] running on GCE node
I20260928 20:17:16.879809 5694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:16.880089 5694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:16.883365 5694 hybrid_clock.cc:648] HybridClock initialized: now 1790626636883338 us; error 37 us; skew 500 ppm
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:16.886356 5694 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:17:16.886896 5694 webserver.cc:460] Webserver started at http://127.24.190.1:43639/ using document root <none> and password file <none>
I20260928 20:17:16.887116 5694 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:16.887202 5694 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:16.921222 5694 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s
I20260928 20:17:16.922391 5740 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.922566 5694 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:17:16.922657 5694 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "2dabc208e35c41469afbbd7e1a739fd9"
format_stamp: "Formatted at 2026-09-28 20:17:15 on dist-test-slave-n45k"
server_key: "c86531b38e490d7518ac3351811d9ab2"
server_key_iv: "c76aae7df318ae670a799e05012b3f9a"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:16.923152 5694 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:16.934172 5694 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:16.936621 5694 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:16.936795 5694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:16.937043 5694 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:16.937465 5694 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:16.937516 5694 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.937547 5694 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:16.937597 5694 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:16.944938 5694 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:44579
I20260928 20:17:16.945010 5853 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:44579 every 8 connection(s)
I20260928 20:17:16.945461 5694 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:17:16.949548 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5694
I20260928 20:17:16.949841 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:34125
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:41005
--webserver_port=38791
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 20:17:16 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626636, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:16.958438 5856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:16.946300 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41005 (local address 127.24.190.1:43185)
0928 20:17:16.946585 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:16.946627 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:16.947154 (+ 527us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:16.947926 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:16.947930 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:16.948171 (+ 241us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:16.948451 (+ 280us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:16.948457 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.950108 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.950109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:16.951288 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:16.951291 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.952320 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.952321 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:16.952408 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:16.952974 (+ 566us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:16.952981 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:16.954320 (+ 1339us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:16.956581 (+ 2261us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:16.956587 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:16.956589 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:16.956888 (+ 299us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:16.957151 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:16.957152 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:16.957152 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:16.957265 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:16.957722 (+ 457us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:16.957728 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:16.957885 (+ 157us) client_negotiation.cc:769] Sending connection context
0928 20:17:16.957987 (+ 102us) client_negotiation.cc:240] Negotiation successful
0928 20:17:16.958134 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":242,"thread_start_us":72,"threads_started":1}
I20260928 20:17:16.959241 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:16.946378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:43185 (local address 127.24.190.62:41005)
0928 20:17:16.947365 (+ 987us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:16.947373 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:16.947408 (+ 35us) server_negotiation.cc:407] Connection header received
0928 20:17:16.947546 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:16.947552 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:16.947607 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:16.947733 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:16.948577 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.949985 (+ 1408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.951388 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:16.952096 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:16.952205 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:16.954450 (+ 2245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:16.954455 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:16.954455 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:16.954466 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:16.956488 (+ 2022us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:16.956979 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:16.956982 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:16.956982 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:16.957081 (+ 99us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:16.957333 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:16.957334 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:16.957334 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:16.957614 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:16.957692 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:16.958978 (+ 1286us) server_negotiation.cc:299] Negotiation successful
0928 20:17:16.959090 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":931,"thread_start_us":69,"threads_started":1}
I20260928 20:17:16.959867 5854 heartbeater.cc:347] Connected to a master server at 127.24.190.62:41005
I20260928 20:17:16.959980 5854 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:16.960170 5854 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
W20260928 20:17:16.961009 5854 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:41005 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 20:17:16.961092 5854 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:16.961162 5854 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:16.961949 5854 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:16.962064 5854 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
W20260928 20:17:16.964062 5854 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 20:17:17.059593 5858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:17.059890 5858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:17.059932 5858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:17.061297 5858 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:17.061389 5858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:17.061447 5858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:17:17.063290 5858 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:34125
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=38791
--tserver_master_addrs=127.24.190.62:41005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5858
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:17.063565 5858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:17.063825 5858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:17.069203 5864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:17.069207 5866 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:17.069326 5863 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:17.070115 5858 server_base.cc:1034] running on GCE node
I20260928 20:17:17.070386 5858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:17.070672 5858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:17.071835 5858 hybrid_clock.cc:648] HybridClock initialized: now 1790626637071820 us; error 35 us; skew 500 ppm
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:17.074608 5858 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:17:17.075192 5858 webserver.cc:460] Webserver started at http://127.24.190.2:38791/ using document root <none> and password file <none>
I20260928 20:17:17.075453 5858 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:17.075529 5858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:17.095947 5858 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:17.099270 5874 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:17.099537 5858 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260928 20:17:17.099637 5858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "a2404b425b71428280712db2a8da3722"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "3cc26932fec9486ac92db6479c2ab623"
server_key_iv: "d0c3a301331e1248cfc7eae5552a3f2b"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:17.100224 5858 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:17.119102 5858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:17.121331 5858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:17.121505 5858 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:17.121749 5858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:17.122151 5858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:17.122265 5858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:17.122366 5858 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:17.122428 5858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:17.129783 5858 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:34125
I20260928 20:17:17.129887 5987 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:34125 every 8 connection(s)
I20260928 20:17:17.130358 5858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:17.138728 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5858
I20260928 20:17:17.139034 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.24.190.20:55679/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:36245
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:41005
--webserver_port=39251
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:41369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:17.141028 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:17.131204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38267 (local address 127.24.190.62:41005)
0928 20:17:17.131249 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:17.131252 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:17.131456 (+ 204us) server_negotiation.cc:407] Connection header received
0928 20:17:17.131949 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:17.131951 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:17.131967 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:17.132049 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:17.132579 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.133364 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.134431 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.134729 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.134805 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:17.137214 (+ 2409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:17.137216 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:17.137216 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:17.137224 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:17.139004 (+ 1780us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:17.139632 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:17.139634 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:17.139634 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:17.139696 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:17.139966 (+ 270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:17.139967 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:17.139968 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:17.140461 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:17.140558 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:17.140850 (+ 292us) server_negotiation.cc:299] Negotiation successful
0928 20:17:17.140940 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:17:17.141251 5990 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:17.131170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41005 (local address 127.24.190.2:38267)
0928 20:17:17.131346 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:17.131381 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:17.131836 (+ 455us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:17.132102 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:17.132105 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:17.132293 (+ 188us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:17.132479 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:17.132483 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.133470 (+ 987us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.133471 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:17.134345 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:17.134348 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.134891 (+ 543us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.134892 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:17.135039 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:17.135594 (+ 555us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:17.135604 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:17.137048 (+ 1444us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:17.139295 (+ 2247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:17.139302 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:17.139304 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:17.139521 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:17.139774 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:17.139775 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:17.139775 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:17.139895 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:17.140585 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:17.140591 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:17.140713 (+ 122us) client_negotiation.cc:769] Sending connection context
0928 20:17:17.140831 (+ 118us) client_negotiation.cc:240] Negotiation successful
0928 20:17:17.140981 (+ 150us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":96,"threads_started":1}
I20260928 20:17:17.142056 5988 heartbeater.cc:347] Connected to a master server at 127.24.190.62:41005
I20260928 20:17:17.142264 5988 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.142560 5988 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
W20260928 20:17:17.143415 5988 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:41005 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 20:17:17.143540 5988 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.143658 5988 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:17.143999 5988 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.144119 5988 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
W20260928 20:17:17.144439 5988 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 20:17:17.235229 5991 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:17.235527 5991 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:17.235572 5991 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:17.237468 5991 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:17.237581 5991 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:17.237643 5991 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:17:17.240114 5991 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:41369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.24.190.20:55679/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:36245
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=39251
--tserver_master_addrs=127.24.190.62:41005
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.5991
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:17.240535 5991 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:17.240844 5991 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:17.251102 5996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:17.254446 5999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:17.254496 5997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:17.255102 5991 server_base.cc:1034] running on GCE node
I20260928 20:17:17.255334 5991 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:17.255661 5991 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:17.256848 5991 hybrid_clock.cc:648] HybridClock initialized: now 1790626637256841 us; error 35 us; skew 500 ppm
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:17.260178 5991 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:17:17.260706 5991 webserver.cc:460] Webserver started at http://127.24.190.3:39251/ using document root <none> and password file <none>
I20260928 20:17:17.261006 5991 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:17.261098 5991 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:17.286505 5991 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s
I20260928 20:17:17.287645 6007 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:17.287815 5991 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:17:17.287895 5991 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "6139ad5f743543ce9da63d2f8507f0d7"
format_stamp: "Formatted at 2026-09-28 20:17:16 on dist-test-slave-n45k"
server_key: "ad5765935b64fe12ea184452f7669906"
server_key_iv: "11e25cf54412b677589342ff2015af7c"
server_key_version: "kuduclusterkey@0"
I20260928 20:17:17.288353 5991 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:17.308514 5991 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:17.310660 5991 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:17.310827 5991 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:17.311072 5991 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:17.311388 5991 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:17.311447 5991 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:17.311492 5991 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:17.311520 5991 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:17.318807 5991 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36245
I20260928 20:17:17.318915 6121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36245 every 8 connection(s)
I20260928 20:17:17.319289 5991 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:17:17.327085 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 5991
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:17.331766 5857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:17.320108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48839 (local address 127.24.190.62:41005)
0928 20:17:17.320155 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:17.320157 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:17.320458 (+ 301us) server_negotiation.cc:407] Connection header received
0928 20:17:17.321026 (+ 568us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:17.321028 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:17.321039 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:17.321084 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:17.321733 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.322231 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.324815 (+ 2584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.325028 (+ 213us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.325123 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:17.328257 (+ 3134us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:17.328259 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:17.328259 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:17.328268 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:17.330008 (+ 1740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:17.330588 (+ 580us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:17.330589 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:17.330590 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:17.330652 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:17.330978 (+ 326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:17.330979 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:17.330980 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:17.331125 (+ 145us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:17.331171 (+ 46us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:17.331567 (+ 396us) server_negotiation.cc:299] Negotiation successful
0928 20:17:17.331658 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:17:17.332438 6124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:17.320147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41005 (local address 127.24.190.3:48839)
0928 20:17:17.320321 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:17.320357 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:17.320906 (+ 549us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:17.321151 (+ 245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:17.321157 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:17.321431 (+ 274us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:17.321628 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:17.321632 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.323704 (+ 2072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.323705 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:17.324701 (+ 996us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:17.324703 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.325152 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.325154 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:17.325292 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:17.325892 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:17.325902 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:17.328138 (+ 2236us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:17.330101 (+ 1963us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:17.330108 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:17.330111 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:17.330493 (+ 382us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:17.330743 (+ 250us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:17.330743 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:17.330744 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:17.330888 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:17.331222 (+ 334us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:17.331228 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:17.331398 (+ 170us) client_negotiation.cc:769] Sending connection context
0928 20:17:17.332129 (+ 731us) client_negotiation.cc:240] Negotiation successful
0928 20:17:17.332268 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260928 20:17:17.333571 6122 heartbeater.cc:347] Connected to a master server at 127.24.190.62:41005
I20260928 20:17:17.333683 6122 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.333920 6122 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
W20260928 20:17:17.334699 6122 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:41005 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260928 20:17:17.334822 6122 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.334918 6122 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:17.335238 6122 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.335353 6122 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
W20260928 20:17:17.335638 6122 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 20:17:17.340181 6126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:17.327706 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46892 (local address 127.24.190.62:41005)
0928 20:17:17.328799 (+ 1093us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:17.328800 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:17.329132 (+ 332us) server_negotiation.cc:407] Connection header received
0928 20:17:17.329280 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:17.329281 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:17.329293 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:17.332581 (+ 3288us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:17.333465 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.334169 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.335325 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:17.335638 (+ 313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:17.335711 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:17.337056 (+ 1345us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:17.337057 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:17.337058 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:17.337064 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:17.338599 (+ 1535us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:17.338995 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:17.338997 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:17.338997 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:17.339055 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:17.339318 (+ 263us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:17.339319 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:17.339320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:17.339467 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:17.339631 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:17.339952 (+ 321us) server_negotiation.cc:299] Negotiation successful
0928 20:17:17.340042 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1065,"thread_start_us":55,"threads_started":1}
Sep 28 20:17:17 dist-test-slave-n45k krb5kdc[4660](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:17.964299 5854 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:17.964468 5854 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:17.964895 5656 ts_manager.cc:194] Registered new tserver with Master: 2dabc208e35c41469afbbd7e1a739fd9 (127.24.190.1:44579)
I20260928 20:17:17.965878 5656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:43185
I20260928 20:17:18.144729 5988 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:18.144920 5988 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:18.145228 5656 ts_manager.cc:194] Registered new tserver with Master: a2404b425b71428280712db2a8da3722 (127.24.190.2:34125)
I20260928 20:17:18.145624 5656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:38267
Sep 28 20:17:18 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
I20260928 20:17:18.335882 6122 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:18.336050 6122 heartbeater.cc:511] Master 127.24.190.62:41005 requested a full tablet report, sending...
I20260928 20:17:18.336436 5656 ts_manager.cc:194] Registered new tserver with Master: 6139ad5f743543ce9da63d2f8507f0d7 (127.24.190.3:36245)
I20260928 20:17:18.336959 5656 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:48839
I20260928 20:17:18.341775 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:17:18.351061 6143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.342906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46898 (local address 127.24.190.62:41005)
0928 20:17:18.343073 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.343075 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.343202 (+ 127us) server_negotiation.cc:407] Connection header received
0928 20:17:18.343297 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.343298 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.343310 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.343351 (+ 41us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:18.344167 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.344976 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.346042 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.346372 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.346413 (+ 41us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.347973 (+ 1560us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:18.347975 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:18.347975 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:18.347982 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:18.349774 (+ 1792us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:18.350154 (+ 380us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:18.350155 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:18.350156 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:18.350211 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:18.350432 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:18.350433 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:18.350433 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:18.350583 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:18.350657 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.350872 (+ 215us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.350956 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":71,"threads_started":1}
I20260928 20:17:18.353727 5656 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46898:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:17:18.355945 5656 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:17:18.372751 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.366817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:34125 (local address 127.0.0.1:53344)
0928 20:17:18.367232 (+ 415us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.367273 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:18.367340 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:18.368082 (+ 742us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:18.368085 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:18.368087 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:18.368165 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.368167 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.369770 (+ 1603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.369771 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.371160 (+ 1389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.371163 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.372448 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.372449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.372534 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.372549 (+ 15us) client_negotiation.cc:769] Sending connection context
0928 20:17:18.372595 (+ 46us) client_negotiation.cc:240] Negotiation successful
0928 20:17:18.372645 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":384,"thread_start_us":66,"threads_started":1}
I20260928 20:17:18.373571 6154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.367254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53344 (local address 127.24.190.2:34125)
0928 20:17:18.367912 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.367917 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.367927 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:18.367961 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.367963 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.367979 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.368234 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:18.368299 (+ 65us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.369674 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.371265 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.372339 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.373358 (+ 1019us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.373428 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.373455 (+ 27us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.373495 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":62,"threads_started":1}
I20260928 20:17:18.374476 5922 tablet_service.cc:1467] Processing CreateTablet for tablet 80b946d602cf4fd98dd6f3f8c29904dc (DEFAULT_TABLE table=test-table [id=8bfb0d4739f94ef5ad403557f0777e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:18.374868 5922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80b946d602cf4fd98dd6f3f8c29904dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:18.381968 6151 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.367045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36245 (local address 127.0.0.1:44846)
0928 20:17:18.372836 (+ 5791us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.372846 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:18.372881 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:18.375908 (+ 3027us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:18.375910 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:18.375912 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:18.375944 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.375945 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.378674 (+ 2729us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.378675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.379757 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.379759 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.381743 (+ 1984us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.381744 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.381815 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.381819 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:18.381849 (+ 30us) client_negotiation.cc:240] Negotiation successful
0928 20:17:18.381892 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5781,"thread_start_us":65,"threads_started":1}
I20260928 20:17:18.382321 6155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.367401 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44846 (local address 127.24.190.3:36245)
0928 20:17:18.373902 (+ 6501us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.373908 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.373919 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:17:18.373955 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.373956 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.373973 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.376018 (+ 2045us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:18.376101 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.377145 (+ 1044us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.380789 (+ 3644us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.381630 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.382084 (+ 454us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.382156 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.382183 (+ 27us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.382228 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6465,"thread_start_us":45,"threads_started":1}
I20260928 20:17:18.382668 6150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.366825 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:44579 (local address 127.0.0.1:57188)
0928 20:17:18.367758 (+ 933us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.367767 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:18.367802 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:18.374535 (+ 6733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:18.374536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:18.374538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:18.374580 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.374581 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.377296 (+ 2715us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.377297 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.378469 (+ 1172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.378472 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.382464 (+ 3992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.382465 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.382533 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.382536 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:17:18.382567 (+ 31us) client_negotiation.cc:240] Negotiation successful
0928 20:17:18.382602 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":917,"thread_start_us":85,"threads_started":1}
I20260928 20:17:18.383080 6153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.367111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57188 (local address 127.24.190.1:44579)
0928 20:17:18.374117 (+ 7006us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.374121 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.374131 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:18.374162 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.374164 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.374179 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.374662 (+ 483us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:18.374759 (+ 97us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.375796 (+ 1037us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.379863 (+ 4067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.380669 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.382783 (+ 2114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.382858 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.382885 (+ 27us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.382972 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6971,"thread_start_us":53,"threads_started":1}
I20260928 20:17:18.383092 6056 tablet_service.cc:1467] Processing CreateTablet for tablet 80b946d602cf4fd98dd6f3f8c29904dc (DEFAULT_TABLE table=test-table [id=8bfb0d4739f94ef5ad403557f0777e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:18.383476 6056 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80b946d602cf4fd98dd6f3f8c29904dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:18.384584 6156 tablet_bootstrap.cc:492] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Bootstrap starting.
I20260928 20:17:18.385293 6156 tablet_bootstrap.cc:654] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:18.386111 6156 log.cc:824] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:18.386593 5770 tablet_service.cc:1467] Processing CreateTablet for tablet 80b946d602cf4fd98dd6f3f8c29904dc (DEFAULT_TABLE table=test-table [id=8bfb0d4739f94ef5ad403557f0777e2b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:18.387115 5770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80b946d602cf4fd98dd6f3f8c29904dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:18.390992 6159 tablet_bootstrap.cc:492] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: Bootstrap starting.
I20260928 20:17:18.391711 6159 tablet_bootstrap.cc:654] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:18.392078 6159 log.cc:824] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:18.392925 6159 tablet_bootstrap.cc:492] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: No bootstrap required, opened a new log
I20260928 20:17:18.392994 6159 ts_tablet_manager.cc:1397] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:17:18.395598 6159 raft_consensus.cc:348] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.395776 6159 raft_consensus.cc:374] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:18.395813 6159 raft_consensus.cc:729] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2dabc208e35c41469afbbd7e1a739fd9, State: Initialized, Role: FOLLOWER
I20260928 20:17:18.396148 6159 consensus_queue.cc:260] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.396553 6159 ts_tablet_manager.cc:1428] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260928 20:17:18.396721 5854 heartbeater.cc:503] Master 127.24.190.62:41005 was elected leader, sending a full tablet report...
I20260928 20:17:18.398860 6157 tablet_bootstrap.cc:492] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Bootstrap starting.
I20260928 20:17:18.399087 6156 tablet_bootstrap.cc:492] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: No bootstrap required, opened a new log
I20260928 20:17:18.399164 6156 ts_tablet_manager.cc:1397] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.001s
I20260928 20:17:18.399626 6157 tablet_bootstrap.cc:654] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:18.399976 6157 log.cc:824] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:18.400828 6157 tablet_bootstrap.cc:492] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: No bootstrap required, opened a new log
I20260928 20:17:18.400890 6157 ts_tablet_manager.cc:1397] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:17:18.402128 6156 raft_consensus.cc:348] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.403007 6156 raft_consensus.cc:374] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:18.403095 6156 raft_consensus.cc:729] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2404b425b71428280712db2a8da3722, State: Initialized, Role: FOLLOWER
I20260928 20:17:18.403302 6156 consensus_queue.cc:260] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.403661 6156 ts_tablet_manager.cc:1428] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s
I20260928 20:17:18.403591 6157 raft_consensus.cc:348] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.403803 6157 raft_consensus.cc:374] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:18.403820 5988 heartbeater.cc:503] Master 127.24.190.62:41005 was elected leader, sending a full tablet report...
I20260928 20:17:18.403892 6157 raft_consensus.cc:729] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6139ad5f743543ce9da63d2f8507f0d7, State: Initialized, Role: FOLLOWER
I20260928 20:17:18.404052 6157 consensus_queue.cc:260] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.404382 6157 ts_tablet_manager.cc:1428] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260928 20:17:18.404536 6122 heartbeater.cc:503] Master 127.24.190.62:41005 was elected leader, sending a full tablet report...
W20260928 20:17:18.447090 5855 tablet.cc:2369] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:17:18.570461 6123 tablet.cc:2369] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Can't schedule compaction. Clean time has not been advanced past its initial value.
Sep 28 20:17:18 dist-test-slave-n45k krb5kdc[4660](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626637, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for HTTP/127.24.190.20@KRBTEST.COM
W20260928 20:17:18.631805 5989 tablet.cc:2369] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:17:18.709064 6161 raft_consensus.cc:482] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:18.709229 6161 raft_consensus.cc:504] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.709646 6161 leader_election.cc:288] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6139ad5f743543ce9da63d2f8507f0d7 (127.24.190.3:36245), a2404b425b71428280712db2a8da3722 (127.24.190.2:34125)
I20260928 20:17:18.716391 6155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.710076 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:60243 (local address 127.24.190.3:36245)
0928 20:17:18.710120 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.710122 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.710324 (+ 202us) server_negotiation.cc:407] Connection header received
0928 20:17:18.710432 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.710434 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.710443 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.710472 (+ 29us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:18.711792 (+ 1320us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.712551 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.715147 (+ 2596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.715722 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.715773 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.715782 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.716265 (+ 483us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.716316 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:17:18.718070 6167 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.709841 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36245 (local address 127.24.190.1:60243)
0928 20:17:18.710221 (+ 380us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.710233 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:18.710353 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:18.711182 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:18.711183 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:18.711185 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:18.711685 (+ 500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.711689 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.713116 (+ 1427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.713117 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.715034 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.715037 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.716103 (+ 1066us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.716104 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.716178 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.716182 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:18.717914 (+ 1732us) client_negotiation.cc:240] Negotiation successful
0928 20:17:18.717966 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":111,"threads_started":1}
I20260928 20:17:18.718616 6076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80b946d602cf4fd98dd6f3f8c29904dc" candidate_uuid: "2dabc208e35c41469afbbd7e1a739fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6139ad5f743543ce9da63d2f8507f0d7" is_pre_election: true
I20260928 20:17:18.718816 6076 raft_consensus.cc:2454] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dabc208e35c41469afbbd7e1a739fd9 in term 0.
I20260928 20:17:18.719090 5742 leader_election.cc:302] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dabc208e35c41469afbbd7e1a739fd9, 6139ad5f743543ce9da63d2f8507f0d7; no voters:
I20260928 20:17:18.719223 6161 raft_consensus.cc:2781] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:17:18.719261 6161 raft_consensus.cc:482] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:17:18.719282 6161 raft_consensus.cc:3037] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:18.720242 6161 raft_consensus.cc:504] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.720374 6161 leader_election.cc:288] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [CANDIDATE]: Term 1 election: Requested vote from peers 6139ad5f743543ce9da63d2f8507f0d7 (127.24.190.3:36245), a2404b425b71428280712db2a8da3722 (127.24.190.2:34125)
I20260928 20:17:18.720685 6076 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80b946d602cf4fd98dd6f3f8c29904dc" candidate_uuid: "2dabc208e35c41469afbbd7e1a739fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6139ad5f743543ce9da63d2f8507f0d7"
I20260928 20:17:18.720755 6076 raft_consensus.cc:3037] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:18.721305 6154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.710070 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:57101 (local address 127.24.190.2:34125)
0928 20:17:18.710114 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.710116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.717932 (+ 7816us) server_negotiation.cc:407] Connection header received
0928 20:17:18.718033 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.718034 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.718044 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.718080 (+ 36us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:18.718296 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.718995 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.720373 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.720938 (+ 565us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.720987 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.720995 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.721199 (+ 204us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.721239 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:17:18.721521 6168 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.709870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:34125 (local address 127.24.190.1:57101)
0928 20:17:18.717871 (+ 8001us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.717883 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:18.717961 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:18.718143 (+ 182us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:18.718143 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:18.718145 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:18.718207 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.718208 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.719099 (+ 891us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.719099 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.720267 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:18.720270 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.721053 (+ 783us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.721054 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:18.721124 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.721128 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:18.721406 (+ 278us) client_negotiation.cc:240] Negotiation successful
0928 20:17:18.721445 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7978,"thread_start_us":83,"threads_started":1}
I20260928 20:17:18.721608 6076 raft_consensus.cc:2454] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dabc208e35c41469afbbd7e1a739fd9 in term 1.
I20260928 20:17:18.721885 5942 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80b946d602cf4fd98dd6f3f8c29904dc" candidate_uuid: "2dabc208e35c41469afbbd7e1a739fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2404b425b71428280712db2a8da3722" is_pre_election: true
I20260928 20:17:18.722013 5942 raft_consensus.cc:2454] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2dabc208e35c41469afbbd7e1a739fd9 in term 0.
I20260928 20:17:18.722100 5742 leader_election.cc:302] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2dabc208e35c41469afbbd7e1a739fd9, 6139ad5f743543ce9da63d2f8507f0d7; no voters:
I20260928 20:17:18.722182 6161 raft_consensus.cc:2781] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:18.721863 5941 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80b946d602cf4fd98dd6f3f8c29904dc" candidate_uuid: "2dabc208e35c41469afbbd7e1a739fd9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2404b425b71428280712db2a8da3722"
I20260928 20:17:18.722254 5941 raft_consensus.cc:3037] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:18.722355 6161 raft_consensus.cc:686] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [term 1 LEADER]: Becoming Leader. State: Replica: 2dabc208e35c41469afbbd7e1a739fd9, State: Running, Role: LEADER
I20260928 20:17:18.722458 6161 consensus_queue.cc:237] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } }
I20260928 20:17:18.723098 5941 raft_consensus.cc:2454] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2dabc208e35c41469afbbd7e1a739fd9 in term 1.
I20260928 20:17:18.723587 5656 catalog_manager.cc:5495] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2dabc208e35c41469afbbd7e1a739fd9 (127.24.190.1). New cstate: current_term: 1 leader_uuid: "2dabc208e35c41469afbbd7e1a739fd9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2dabc208e35c41469afbbd7e1a739fd9" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44579 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 } health_report { overall_health: UNKNOWN } } }
I20260928 20:17:18.810897 6153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.807405 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57204 (local address 127.24.190.1:44579)
0928 20:17:18.807446 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:18.807447 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:18.807454 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:17:18.807495 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:18.807495 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:18.807516 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:18.807588 (+ 72us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:17:18.807770 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.808549 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.809748 (+ 1199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:18.810046 (+ 298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:18.810107 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:18.810336 (+ 229us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:17:18.810472 (+ 136us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:17:18.810546 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:18.810792 (+ 246us) server_negotiation.cc:299] Negotiation successful
0928 20:17:18.810815 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:17:18.813050 5941 raft_consensus.cc:1261] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 1 FOLLOWER]: Refusing update from remote peer 2dabc208e35c41469afbbd7e1a739fd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:18.813490 6169 consensus_queue.cc:1035] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2404b425b71428280712db2a8da3722" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 34125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:18.814574 6076 raft_consensus.cc:1261] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 1 FOLLOWER]: Refusing update from remote peer 2dabc208e35c41469afbbd7e1a739fd9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:18.814877 6169 consensus_queue.cc:1035] T 80b946d602cf4fd98dd6f3f8c29904dc P 2dabc208e35c41469afbbd7e1a739fd9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6139ad5f743543ce9da63d2f8507f0d7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:18.818168 6173 mvcc.cc:205] Tried to move back new op lower bound from 7334406712575537152 to 7334406712207699968. Current Snapshot: MvccSnapshot[applied={T|T < 7334406712575537152}]
I20260928 20:17:18.818343 6172 mvcc.cc:205] Tried to move back new op lower bound from 7334406712575537152 to 7334406712207699968. Current Snapshot: MvccSnapshot[applied={T|T < 7334406712575537152}]
I20260928 20:17:18.818477 6175 mvcc.cc:205] Tried to move back new op lower bound from 7334406712575537152 to 7334406712207699968. Current Snapshot: MvccSnapshot[applied={T|T < 7334406712575537152}]
I20260928 20:17:18.821054 5655 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:18.821154 5655 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46898:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:18.821960 5655 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 3c931e7cce6745958f6f9c0769ce307d: Sending DeleteTablet for 3 replicas of tablet 80b946d602cf4fd98dd6f3f8c29904dc
I20260928 20:17:18.822358 5922 tablet_service.cc:1514] Processing DeleteTablet for tablet 80b946d602cf4fd98dd6f3f8c29904dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:18 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:53344
I20260928 20:17:18.822796 6056 tablet_service.cc:1514] Processing DeleteTablet for tablet 80b946d602cf4fd98dd6f3f8c29904dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:18 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:44846
I20260928 20:17:18.823137 5770 tablet_service.cc:1514] Processing DeleteTablet for tablet 80b946d602cf4fd98dd6f3f8c29904dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:18 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:57188
I20260928 20:17:18.823757 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5694
I20260928 20:17:18.825817 6182 tablet_replica.cc:330] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: stopping tablet replica
I20260928 20:17:18.825950 6181 tablet_replica.cc:330] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: stopping tablet replica
I20260928 20:17:18.826097 6181 raft_consensus.cc:2229] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:17:18.826215 6182 raft_consensus.cc:2229] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:17:18.826448 6181 raft_consensus.cc:2258] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:18.826599 6182 raft_consensus.cc:2258] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:18.827135 6182 ts_tablet_manager.cc:1905] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:18.829242 6181 ts_tablet_manager.cc:1905] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:18.830832 6181 ts_tablet_manager.cc:1918] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:18.830929 6181 log.cc:1196] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/80b946d602cf4fd98dd6f3f8c29904dc
I20260928 20:17:18.831229 6181 ts_tablet_manager.cc:1939] T 80b946d602cf4fd98dd6f3f8c29904dc P a2404b425b71428280712db2a8da3722: Deleting consensus metadata
I20260928 20:17:18.831470 6182 ts_tablet_manager.cc:1918] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:18.831565 6182 log.cc:1196] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/80b946d602cf4fd98dd6f3f8c29904dc
W20260928 20:17:18.831610 5640 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:44579 (error 108)
I20260928 20:17:18.831861 6182 ts_tablet_manager.cc:1939] T 80b946d602cf4fd98dd6f3f8c29904dc P 6139ad5f743543ce9da63d2f8507f0d7: Deleting consensus metadata
I20260928 20:17:18.832252 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5858
I20260928 20:17:18.833952 6150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.833781 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:44579 (local address 127.0.0.1:57208)
0928 20:17:18.833869 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.833916 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:44579: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260928 20:17:18.834962 5641 catalog_manager.cc:4841] TS 6139ad5f743543ce9da63d2f8507f0d7 (127.24.190.3:36245): tablet 80b946d602cf4fd98dd6f3f8c29904dc (table test-table [id=8bfb0d4739f94ef5ad403557f0777e2b]) successfully deleted
W20260928 20:17:18.835114 5640 catalog_manager.cc:4584] TS 2dabc208e35c41469afbbd7e1a739fd9 (127.24.190.1:44579): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 80b946d602cf4fd98dd6f3f8c29904dc: Network error: Client connection negotiation failed: client connection to 127.24.190.1:44579: connect: Connection refused (error 111)
I20260928 20:17:18.838526 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5991
I20260928 20:17:18.840353 6150 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:18.840250 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:34125 (local address 127.0.0.1:53348)
0928 20:17:18.840295 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:18.840320 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.2:34125: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
I20260928 20:17:18.844496 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 5623
I20260928 20:17:18.849328 25336 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260928 20:17:19.194043 25336 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260928 20:17:19.194147 25336 mini_ranger.cc:66] Stopping Ranger...
I20260928 20:17:19.539197 25336 mini_ranger.cc:68] Stopped Ranger
2026-09-28 20:17:19.539 UTC [4690] LOG: received smart shutdown request
2026-09-28 20:17:19.543 UTC [4690] LOG: background worker "logical replication launcher" (PID 4699) exited with exit code 1
2026-09-28 20:17:19.544 UTC [4694] LOG: shutting down
2026-09-28 20:17:19.743 UTC [4690] LOG: database system is shut down
2026-09-28T20:17:19Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (49614 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:17:19 dist-test-slave-n45k krb5kdc[6193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:17:19 dist-test-slave-n45k krb5kdc[6193](info): set up 2 sockets
Sep 28 20:17:19 dist-test-slave-n45k krb5kdc[6193](info): commencing operation
krb5kdc: starting...
W20260928 20:17:20.934605 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.057s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:17:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:17:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:17:21.055397 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43073
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43073,127.24.190.61:45669,127.24.190.60:38759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:21.143589 6206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:21.143857 6206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:21.143898 6206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:21.145181 6206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:21.145258 6206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:21.145287 6206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:21.145324 6206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:21.145351 6206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:21.147158 6206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43073,127.24.190.61:45669,127.24.190.60:38759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:21.147476 6206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:21.147725 6206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:21.153055 6212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:21.153051 6214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:21.153049 6211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:21.153090 6206 server_base.cc:1034] running on GCE node
I20260928 20:17:21.153558 6206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:21.153859 6206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:21.155026 6206 hybrid_clock.cc:648] HybridClock initialized: now 1790626641154988 us; error 76 us; skew 500 ppm
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:21.157529 6206 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:21.157989 6206 webserver.cc:460] Webserver started at http://127.24.190.62:46753/ using document root <none> and password file <none>
I20260928 20:17:21.158210 6206 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:21.158299 6206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:21.158455 6206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:21.159518 6206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "1723d3e51e524717897856efb2e8642c"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "f4deac1ce8f80240d71ed43becae8ffd"
server_key_iv: "c4c476898505ed602bcbaf9843c86210"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.159888 6206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "1723d3e51e524717897856efb2e8642c"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "f4deac1ce8f80240d71ed43becae8ffd"
server_key_iv: "c4c476898505ed602bcbaf9843c86210"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.161216 6206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:17:21.161929 6221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:21.162181 6206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:21.162355 6206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "1723d3e51e524717897856efb2e8642c"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "f4deac1ce8f80240d71ed43becae8ffd"
server_key_iv: "c4c476898505ed602bcbaf9843c86210"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.162446 6206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:21.193574 6206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:21.196089 6206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:21.196271 6206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:21.200495 6206 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43073
I20260928 20:17:21.200532 6273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43073 every 8 connection(s)
I20260928 20:17:21.200910 6206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:21.201778 6274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:21.203308 6274 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:21.210472 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6206
I20260928 20:17:21.210598 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:17:21.210779 25336 external_mini_cluster.cc:1428] Setting key def48636c2d2286afd34fe11c684a5d7
I20260928 20:17:21.213727 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.203947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43073 (local address 127.0.0.1:46596)
0928 20:17:21.204124 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.204159 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.204665 (+ 506us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.205034 (+ 369us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.205037 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.205293 (+ 256us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.205473 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.205477 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.206512 (+ 1035us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.206513 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.207188 (+ 675us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.207190 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.207680 (+ 490us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.207681 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.207746 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.208365 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.208373 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.209730 (+ 1357us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.212180 (+ 2450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.212186 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.212188 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.212403 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.212685 (+ 282us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.212686 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.212686 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.212768 (+ 82us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.213124 (+ 356us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.213129 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.213197 (+ 68us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.213299 (+ 102us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.213529 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":134,"mutex_wait_us":96,"thread_start_us":86,"threads_started":1}
I20260928 20:17:21.213727 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.203974 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46596 (local address 127.24.190.62:43073)
0928 20:17:21.204816 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.204819 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.204830 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:17:21.204899 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.204900 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.204914 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.204978 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.205570 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.206428 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.207264 (+ 836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.207573 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.207657 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.209825 (+ 2168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.209833 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.209833 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.209840 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.212089 (+ 2249us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.212519 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.212526 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.212526 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.212605 (+ 79us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.212841 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.212842 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.212842 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.213051 (+ 209us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.213146 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.213323 (+ 177us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.213481 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":820,"thread_start_us":77,"threads_started":1}
I20260928 20:17:21.214537 6274 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:17:21.214898 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.214771 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51340)
0928 20:17:21.214826 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.214869 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
W20260928 20:17:21.215019 6224 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
I20260928 20:17:21.215461 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.215366 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51354)
0928 20:17:21.215414 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.215438 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 20:17:21.215565 6274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:45669: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.24.190.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.61@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab.
Entry for principal kudu/127.24.190.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab.
I20260928 20:17:21.238481 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:45669
--webserver_interface=127.24.190.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab
--principal=kudu/127.24.190.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43073,127.24.190.61:45669,127.24.190.60:38759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:21.264788 6274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } attempt: 1
I20260928 20:17:21.265318 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.265176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51358)
0928 20:17:21.265240 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.265276 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260928 20:17:21.265669 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.265553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51374)
0928 20:17:21.265599 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.265640 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 20:17:21.265784 6274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:45669: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
W20260928 20:17:21.319167 6281 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:21.319456 6281 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:21.319499 6281 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:21.320737 6281 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:21.320822 6281 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:21.320844 6281 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:21.320865 6281 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:21.320899 6281 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:21.322527 6281 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43073,127.24.190.61:45669,127.24.190.60:38759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab
--principal=kudu/127.24.190.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:45669
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.190.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6281
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:21.322839 6281 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:21.323081 6281 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:21.328327 6286 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:21.328375 6287 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:21.328397 6289 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:21.328454 6281 server_base.cc:1034] running on GCE node
I20260928 20:17:21.328890 6281 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:21.329216 6281 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:21.330363 6281 hybrid_clock.cc:648] HybridClock initialized: now 1790626641330344 us; error 51 us; skew 500 ppm
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:21.333060 6281 init.cc:377] Logged in from keytab as kudu/127.24.190.61@KRBTEST.COM (short username kudu)
I20260928 20:17:21.333529 6281 webserver.cc:460] Webserver started at http://127.24.190.61:41571/ using document root <none> and password file <none>
I20260928 20:17:21.333767 6281 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:21.333848 6281 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:21.333926 6274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } attempt: 2
I20260928 20:17:21.334023 6281 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:21.334399 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.334220 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51380)
0928 20:17:21.334311 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.334357 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260928 20:17:21.334772 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.334675 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51394)
0928 20:17:21.334723 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.334749 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 20:17:21.334887 6274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:45669: Network error: Client connection negotiation failed: client connection to 127.24.190.61:45669: connect: Connection refused (error 111)
I20260928 20:17:21.335382 6281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data/instance:
uuid: "83c7d1777448493f8d4225ba660486d0"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "56ccce8fae304709a781de0a9c62d45f"
server_key_iv: "dda89b84b0af84d7d6809e52d0228092"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.335692 6281 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal/instance:
uuid: "83c7d1777448493f8d4225ba660486d0"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "56ccce8fae304709a781de0a9c62d45f"
server_key_iv: "dda89b84b0af84d7d6809e52d0228092"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.337009 6281 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:17:21.337786 6296 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:21.338025 6281 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:21.338128 6281 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal
uuid: "83c7d1777448493f8d4225ba660486d0"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "56ccce8fae304709a781de0a9c62d45f"
server_key_iv: "dda89b84b0af84d7d6809e52d0228092"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.338222 6281 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:21.353906 6281 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:21.355836 6281 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:21.356006 6281 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:21.359999 6281 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.61:45669
I20260928 20:17:21.360049 6348 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.61:45669 every 8 connection(s)
I20260928 20:17:21.360436 6281 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
I20260928 20:17:21.361328 6349 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:21.362993 6349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:17:21.363381 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6281
I20260928 20:17:21.363492 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-1/wal/instance
I20260928 20:17:21.363669 25336 external_mini_cluster.cc:1428] Setting key 7ce6e4a5841a6d238dabf420b648fe75
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.60@KRBTEST.COM; defaulting to no policy
I20260928 20:17:21.372665 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.363761 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46612 (local address 127.24.190.62:43073)
0928 20:17:21.363826 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.363829 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.364059 (+ 230us) server_negotiation.cc:407] Connection header received
0928 20:17:21.364487 (+ 428us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.364488 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.364504 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.364585 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.365338 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.365856 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.367023 (+ 1167us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.367270 (+ 247us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.367360 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.369621 (+ 2261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.369622 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.369623 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.369631 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.371200 (+ 1569us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.371591 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.371592 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.371593 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.371660 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.371942 (+ 282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.371943 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.371945 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.372110 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.372204 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.372480 (+ 276us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.372563 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 20:17:21.372826 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.363762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43073 (local address 127.0.0.1:46612)
0928 20:17:21.363921 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.363962 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.364399 (+ 437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.364637 (+ 238us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.364640 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.364983 (+ 343us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.365242 (+ 259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.365247 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.365957 (+ 710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.365958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.366927 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.366929 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.367372 (+ 443us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.367373 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.367510 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.368097 (+ 587us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.368105 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.369523 (+ 1418us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.371282 (+ 1759us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.371290 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.371292 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.371513 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.371728 (+ 215us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.371729 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.371729 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.371841 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.372195 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.372201 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.372341 (+ 140us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.372445 (+ 104us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.372598 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":82,"threads_started":1}
I20260928 20:17:21.373473 6349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.60@KRBTEST.COM" created.
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:17:21.381362 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.373780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51398)
0928 20:17:21.373830 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.373841 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.373892 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.374218 (+ 326us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.374219 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.374413 (+ 194us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.374475 (+ 62us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.374477 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.375346 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.375347 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.375842 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.375843 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.376427 (+ 584us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.376428 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.376494 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.376922 (+ 428us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.376927 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.378496 (+ 1569us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.380310 (+ 1814us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.380311 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.380312 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.380474 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.380694 (+ 220us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.380695 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.380695 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.380748 (+ 53us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.381042 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.381043 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.381079 (+ 36us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.381143 (+ 64us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.381243 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260928 20:17:21.381386 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.373813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51398 (local address 127.24.190.61:45669)
0928 20:17:21.374046 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.374051 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.374074 (+ 23us) server_negotiation.cc:407] Connection header received
0928 20:17:21.374098 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.374109 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.374130 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.374194 (+ 64us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.374551 (+ 357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.375238 (+ 687us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.375939 (+ 701us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.376329 (+ 390us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.376430 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.378606 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.378614 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.378614 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.378621 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.380202 (+ 1581us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.380568 (+ 366us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.380570 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.380571 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.380626 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.380824 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.380825 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.380826 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.380970 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.381065 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.381171 (+ 106us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.381295 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":61,"server-negotiator.queue_time_us":199,"thread_start_us":121,"threads_started":1}
I20260928 20:17:21.382031 6349 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:17:21.382453 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.382292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37926)
0928 20:17:21.382389 (+ 97us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.382433 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
W20260928 20:17:21.382648 6297 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
I20260928 20:17:21.383114 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.383026 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37938)
0928 20:17:21.383073 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.383097 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260928 20:17:21.383299 6349 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:38759: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab.
Entry for principal kudu/127.24.190.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab.
I20260928 20:17:21.390102 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:38759
--webserver_interface=127.24.190.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab
--principal=kudu/127.24.190.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43073,127.24.190.61:45669,127.24.190.60:38759
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:21.426028 6274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } attempt: 3
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:17:21.432555 6349 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } attempt: 1
I20260928 20:17:21.432992 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.432860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37942)
0928 20:17:21.432909 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.432947 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":26}
I20260928 20:17:21.433698 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.433609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37954)
0928 20:17:21.433647 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.433670 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260928 20:17:21.433847 6349 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:38759: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
I20260928 20:17:21.435575 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.426465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51400)
0928 20:17:21.426518 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.426532 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.426597 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.426809 (+ 212us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.426810 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.427021 (+ 211us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.427098 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.427100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.428138 (+ 1038us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.428140 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.428957 (+ 817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.428960 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.429515 (+ 555us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.429516 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.429603 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.430162 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.430167 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.431797 (+ 1630us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.434443 (+ 2646us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.434444 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.434444 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.434659 (+ 215us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.434890 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.434891 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.434892 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.434957 (+ 65us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.435263 (+ 306us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.435264 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.435314 (+ 50us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.435381 (+ 67us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.435477 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":26}
I20260928 20:17:21.435645 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.426615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51400 (local address 127.24.190.61:45669)
0928 20:17:21.426661 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.426664 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.426674 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:21.426706 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.426707 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.426719 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.426801 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.427172 (+ 371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.428042 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.429044 (+ 1002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.429409 (+ 365us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.429486 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.431906 (+ 2420us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.431908 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.431908 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.431918 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.434355 (+ 2437us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.434747 (+ 392us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.434748 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.434749 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.434814 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.435028 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.435029 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.435029 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.435186 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.435264 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.435426 (+ 162us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.435516 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:17:21.436389 6274 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:17:21.436754 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.436641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37964)
0928 20:17:21.436691 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.436725 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
I20260928 20:17:21.437168 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.437093 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37968)
0928 20:17:21.437123 (+ 30us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.437149 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260928 20:17:21.437314 6274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:38759: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
I20260928 20:17:21.468478 6274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } attempt: 1
I20260928 20:17:21.469034 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.468871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37978)
0928 20:17:21.468937 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.468989 (+ 52us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
I20260928 20:17:21.469441 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.469341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37980)
0928 20:17:21.469387 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.469417 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 20:17:21.469583 6274 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:38759: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
W20260928 20:17:21.486937 6356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:21.487134 6356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:21.487155 6356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:21.488286 6356 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:21.488325 6356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:21.488340 6356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:21.488391 6356 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:21.488416 6356 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:21.489920 6356 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43073,127.24.190.61:45669,127.24.190.60:38759
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab
--principal=kudu/127.24.190.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:38759
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.190.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6356
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:21.490172 6356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:21.490423 6356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:21.495333 6361 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:21.495514 6356 server_base.cc:1034] running on GCE node
W20260928 20:17:21.495345 6362 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:21.495345 6364 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:21.495862 6356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:21.496172 6356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:21.497335 6356 hybrid_clock.cc:648] HybridClock initialized: now 1790626641497332 us; error 39 us; skew 500 ppm
I20260928 20:17:21.501995 6349 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } attempt: 2
I20260928 20:17:21.502471 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.502353 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37990)
0928 20:17:21.502408 (+ 55us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.502442 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 20:17:21.502804 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.502725 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37992)
0928 20:17:21.502765 (+ 40us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.502789 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260928 20:17:21.502887 6349 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:38759: Network error: Client connection negotiation failed: client connection to 127.24.190.60:38759: connect: Connection refused (error 111)
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:21.506608 6356 init.cc:377] Logged in from keytab as kudu/127.24.190.60@KRBTEST.COM (short username kudu)
I20260928 20:17:21.507122 6356 webserver.cc:460] Webserver started at http://127.24.190.60:45229/ using document root <none> and password file <none>
I20260928 20:17:21.507445 6356 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:21.507525 6356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:21.507695 6356 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:21.508881 6356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data/instance:
uuid: "c4773a6d19544339ba4bddd7ec2e67cf"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "392cd1868f380c7f6f3242c77a90cdfd"
server_key_iv: "4a003b8b6e41ecf7c8adb3672ac3b35b"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.509290 6356 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal/instance:
uuid: "c4773a6d19544339ba4bddd7ec2e67cf"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "392cd1868f380c7f6f3242c77a90cdfd"
server_key_iv: "4a003b8b6e41ecf7c8adb3672ac3b35b"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.510799 6356 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:17:21.511613 6371 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:21.511797 6356 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:17:21.511907 6356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal
uuid: "c4773a6d19544339ba4bddd7ec2e67cf"
format_stamp: "Formatted at 2026-09-28 20:17:21 on dist-test-slave-n45k"
server_key: "392cd1868f380c7f6f3242c77a90cdfd"
server_key_iv: "4a003b8b6e41ecf7c8adb3672ac3b35b"
server_key_version: "encryptionkey@0"
I20260928 20:17:21.511992 6356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:21.535270 6356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:21.537381 6356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:21.537573 6356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:21.542016 6356 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.60:38759
I20260928 20:17:21.542052 6423 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.60:38759 every 8 connection(s)
I20260928 20:17:21.542546 6356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
I20260928 20:17:21.543749 6424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:21.544783 6274 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } attempt: 2
I20260928 20:17:21.545200 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6356
I20260928 20:17:21.545303 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACert.1790626483051462-25336-0/minicluster-data/master-2/wal/instance
I20260928 20:17:21.545507 25336 external_mini_cluster.cc:1428] Setting key 1306fbaca5122655451868ed50bae7d7
I20260928 20:17:21.545848 6424 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:17:21.556077 6276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.545161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:37998)
0928 20:17:21.545218 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.545234 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.545300 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.546515 (+ 1215us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.546516 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.546720 (+ 204us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.546775 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.546778 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.548083 (+ 1305us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.548084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.548898 (+ 814us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.548899 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.550208 (+ 1309us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.550209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.550263 (+ 54us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.550720 (+ 457us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.550725 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.552277 (+ 1552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.554466 (+ 2189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.554468 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.554469 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.554758 (+ 289us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.555051 (+ 293us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.555052 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.555052 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.555121 (+ 69us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.555680 (+ 559us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.555682 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.555742 (+ 60us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.555860 (+ 118us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.555965 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260928 20:17:21.556491 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.547052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46616 (local address 127.24.190.62:43073)
0928 20:17:21.547091 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.547092 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.547608 (+ 516us) server_negotiation.cc:407] Connection header received
0928 20:17:21.547666 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.547667 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.547676 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.547735 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.548216 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.548898 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.550022 (+ 1124us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.550316 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.550384 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.553551 (+ 3167us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.553552 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.553552 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.553561 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.555188 (+ 1627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.555589 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.555597 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.555597 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.555654 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.555855 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.555856 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.555856 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.555970 (+ 114us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.556041 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.556326 (+ 285us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.556404 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":21}
I20260928 20:17:21.556846 6429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.547011 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43073 (local address 127.0.0.1:46616)
0928 20:17:21.547491 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.547534 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.547606 (+ 72us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.547749 (+ 143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.547752 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.548074 (+ 322us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.548138 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.548139 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.549027 (+ 888us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.549028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.549832 (+ 804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.549835 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.550446 (+ 611us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.550447 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.550526 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.550966 (+ 440us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.550974 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.553472 (+ 2498us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.555292 (+ 1820us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.555300 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.555302 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.555497 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.555722 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.555723 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.555724 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.555781 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.556044 (+ 263us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.556052 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.556151 (+ 99us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.556586 (+ 435us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.556714 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"thread_start_us":75,"threads_started":1}
I20260928 20:17:21.556913 6426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.545370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37998 (local address 127.24.190.60:38759)
0928 20:17:21.545583 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.545594 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.545628 (+ 34us) server_negotiation.cc:407] Connection header received
0928 20:17:21.546287 (+ 659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.546296 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.546368 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.546513 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.546876 (+ 363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.548002 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.549911 (+ 1909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.550140 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.550198 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.552386 (+ 2188us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.552394 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.552395 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.552403 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.554396 (+ 1993us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.554854 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.554857 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.554858 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.554973 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.555196 (+ 223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.555197 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.555198 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.555569 (+ 371us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.556340 (+ 771us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.556398 (+ 58us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.556535 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":15,"server-negotiator.queue_time_us":164,"thread_start_us":106,"threads_started":1}
I20260928 20:17:21.557518 6424 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:17:21.558314 6428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.545890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38010 (local address 127.24.190.60:38759)
0928 20:17:21.546228 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.546230 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.546237 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:17:21.546265 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.546297 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.546368 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.546513 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.547439 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.548261 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.548987 (+ 726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.549626 (+ 639us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.549743 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.553595 (+ 3852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.553596 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.553596 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.553603 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.556386 (+ 2783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.556798 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.556799 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.556799 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.556957 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.557306 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.557307 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.557307 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.557448 (+ 141us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.558026 (+ 578us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.558069 (+ 43us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.558177 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":319,"thread_start_us":80,"threads_started":1}
I20260928 20:17:21.559211 6274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: Bootstrap starting.
I20260928 20:17:21.559938 6274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:21.560276 6274 log.cc:824] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:21.561131 6274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: No bootstrap required, opened a new log
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:17:21.563230 6274 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.563382 6274 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:21.563417 6274 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1723d3e51e524717897856efb2e8642c, State: Initialized, Role: FOLLOWER
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:21.563531 6274 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.563855 6274 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: configured and running, proceeding with master startup.
W20260928 20:17:21.565822 6442 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:17:21.565920 6442 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:17:21.566169 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.557870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51412 (local address 127.24.190.61:45669)
0928 20:17:21.557916 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.557918 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.557926 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:17:21.557952 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.557952 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.557963 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.558019 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.558397 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.559142 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.560107 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.560401 (+ 294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.560451 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.562608 (+ 2157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.562610 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.562610 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.562617 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.564197 (+ 1580us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.565136 (+ 939us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.565138 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.565138 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.565203 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.565544 (+ 341us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.565545 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.565545 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.565699 (+ 154us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.565743 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.565957 (+ 214us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.566035 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:17:21.566524 6429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.557790 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:45669 (local address 127.0.0.1:51412)
0928 20:17:21.557828 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.557837 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.557870 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.558039 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.558040 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.558223 (+ 183us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.558298 (+ 75us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.558300 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.559241 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.559241 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.559971 (+ 730us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.559974 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.560532 (+ 558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.560533 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.560603 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.561022 (+ 419us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.561028 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.562504 (+ 1476us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.564521 (+ 2017us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.564522 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.564522 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.564774 (+ 252us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.565393 (+ 619us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.565394 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.565394 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.565457 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.565793 (+ 336us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.565794 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.565837 (+ 43us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.566322 (+ 485us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.566428 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":24}
I20260928 20:17:21.567265 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.558949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46626 (local address 127.24.190.62:43073)
0928 20:17:21.558984 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.558986 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.558995 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:17:21.559064 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.559065 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.559073 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.559127 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.559646 (+ 519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.560186 (+ 540us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.561093 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.561392 (+ 299us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.561459 (+ 67us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.564036 (+ 2577us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.564038 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.564039 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.564047 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.565755 (+ 1708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.566146 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.566147 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.566148 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.566213 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.566449 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.566450 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.566450 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.566569 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.566709 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.567128 (+ 419us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.567213 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:17:21.566655 6206 master_runner.cc:186] Error getting master registration for 127.24.190.61:45669: OK, instance_id { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" instance_seqno: 1790626641358895 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:17:21.569031 6206 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:17:21.569120 6424 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:17:21.569296 6431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.569645 6431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: This master's current role is: FOLLOWER
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:17:21.577311 6429 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.569364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:38022)
0928 20:17:21.569439 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.569450 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.569486 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.569741 (+ 255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.569742 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.569889 (+ 147us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.569927 (+ 38us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.569928 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.570761 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.570762 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.571334 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.571336 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.571830 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.571831 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.571884 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.572503 (+ 619us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.572507 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.573997 (+ 1490us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.576072 (+ 2075us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.576073 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.576073 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.576278 (+ 205us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.576505 (+ 227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.576506 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.576506 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.576569 (+ 63us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.576985 (+ 416us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.576986 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.577023 (+ 37us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.577100 (+ 77us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.577203 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":60}
I20260928 20:17:21.577409 6428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.569475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38022 (local address 127.24.190.60:38759)
0928 20:17:21.569512 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.569514 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.569523 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:17:21.569542 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.569543 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.569553 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.569609 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.570020 (+ 411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.570676 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.571425 (+ 749us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.571745 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.571818 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.574102 (+ 2284us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.574103 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.574103 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.574110 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.575964 (+ 1854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.576365 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.576366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.576366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.576427 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.576654 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.576655 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.576656 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.576894 (+ 238us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.576962 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.577146 (+ 184us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.577268 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":20}
I20260928 20:17:21.578032 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.569628 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51414 (local address 127.24.190.61:45669)
0928 20:17:21.569662 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.569664 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.569670 (+ 6us) server_negotiation.cc:407] Connection header received
0928 20:17:21.569689 (+ 19us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.569689 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.569697 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.569744 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.570381 (+ 637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.571076 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.571871 (+ 795us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.572130 (+ 259us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.572211 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.575107 (+ 2896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.575109 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.575109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.575122 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.576846 (+ 1724us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.577210 (+ 364us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.577212 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.577212 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.577266 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.577459 (+ 193us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.577460 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.577460 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.577572 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.577817 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.577857 (+ 40us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.577936 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:17:21.579106 6424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf: Bootstrap starting.
I20260928 20:17:21.579721 6424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:21.579995 6424 log.cc:824] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:21.580793 6424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf: No bootstrap required, opened a new log
I20260928 20:17:21.582772 6424 raft_consensus.cc:348] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.582924 6424 raft_consensus.cc:374] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:21.582957 6424 raft_consensus.cc:729] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c4773a6d19544339ba4bddd7ec2e67cf, State: Initialized, Role: FOLLOWER
I20260928 20:17:21.583106 6424 consensus_queue.cc:260] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.583406 6424 sys_catalog.cc:564] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:21.583380 6445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.583586 6445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:17:21.584591 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
W20260928 20:17:21.585615 6456 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:17:21.585667 6456 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:17:21.588148 6356 master_runner.cc:186] Error getting master registration for 127.24.190.61:45669: OK, instance_id { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" instance_seqno: 1790626641358895 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:17:21.590430 6356 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:17:21.594002 6349 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } attempt: 3
I20260928 20:17:21.597769 6277 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.586200 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46638 (local address 127.24.190.62:43073)
0928 20:17:21.586245 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.586247 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.586892 (+ 645us) server_negotiation.cc:407] Connection header received
0928 20:17:21.587245 (+ 353us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.587247 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.587260 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.587293 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.588058 (+ 765us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.588774 (+ 716us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.589807 (+ 1033us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.590102 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.590145 (+ 43us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.591777 (+ 1632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.591778 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.591779 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.591786 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.593391 (+ 1605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.593765 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.593766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.593766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.593819 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.594171 (+ 352us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.594172 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.594172 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.594356 (+ 184us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.594435 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.597593 (+ 3158us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.597677 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:17:21.597769 6353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.586509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51416 (local address 127.24.190.61:45669)
0928 20:17:21.586658 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.586660 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.590603 (+ 3943us) server_negotiation.cc:407] Connection header received
0928 20:17:21.590670 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.590671 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.590682 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.590731 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.591468 (+ 737us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.592189 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.593229 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.593539 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.593595 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.595002 (+ 1407us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.595003 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.595003 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.595010 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.596563 (+ 1553us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.596953 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.596954 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.596955 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.597004 (+ 49us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.597210 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.597211 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.597212 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.597331 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.597401 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.597611 (+ 210us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.597683 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
Sep 28 20:17:21 dist-test-slave-n45k krb5kdc[6193](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626641, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:17:21.603471 6426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.594462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38038 (local address 127.24.190.60:38759)
0928 20:17:21.594511 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.594514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.594522 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:17:21.594544 (+ 22us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.594545 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.594556 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.594610 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.594942 (+ 332us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.595695 (+ 753us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.596736 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.597098 (+ 362us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.597155 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.600273 (+ 3118us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.600274 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.600275 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.600281 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.602312 (+ 2031us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.602688 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.602689 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.602690 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.602743 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.602944 (+ 201us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.602945 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.602946 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.603090 (+ 144us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.603150 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.603310 (+ 160us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.603380 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:17:21.603471 6351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.594241 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:38759 (local address 127.0.0.1:38038)
0928 20:17:21.594341 (+ 100us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:21.594351 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:21.594386 (+ 35us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:21.594658 (+ 272us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:21.594659 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:21.594823 (+ 164us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:21.594862 (+ 39us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.594864 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.595801 (+ 937us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.595802 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.596644 (+ 842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:21.596650 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.597202 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.597203 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:21.597260 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.598720 (+ 1460us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:21.598725 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:21.600187 (+ 1462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:21.602394 (+ 2207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.602395 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.602396 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.602606 (+ 210us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.602817 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:21.602818 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:21.602818 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:21.602875 (+ 57us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:21.603156 (+ 281us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:21.603158 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:21.603199 (+ 41us) client_negotiation.cc:769] Sending connection context
0928 20:17:21.603288 (+ 89us) client_negotiation.cc:240] Negotiation successful
0928 20:17:21.603380 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":84}
I20260928 20:17:21.605484 6428 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:21.586633 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38032 (local address 127.24.190.60:38759)
0928 20:17:21.586737 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:21.586739 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:21.598050 (+ 11311us) server_negotiation.cc:407] Connection header received
0928 20:17:21.598143 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:21.598144 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:21.598153 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:21.598179 (+ 26us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:21.598786 (+ 607us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.599451 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.600422 (+ 971us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:21.600719 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:21.600761 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:21.602131 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:21.602132 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:21.602133 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:21.602139 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:21.604247 (+ 2108us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.604656 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.604657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.604657 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.604708 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:21.604902 (+ 194us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:21.604902 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:21.604903 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:21.605016 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:21.605098 (+ 82us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:21.605320 (+ 222us) server_negotiation.cc:299] Negotiation successful
0928 20:17:21.605402 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260928 20:17:21.605567 6349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: Bootstrap starting.
I20260928 20:17:21.606218 6349 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:21.606580 6349 log.cc:824] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:21.614921 6349 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: No bootstrap required, opened a new log
I20260928 20:17:21.616581 6349 raft_consensus.cc:348] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.616721 6349 raft_consensus.cc:374] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:21.616767 6349 raft_consensus.cc:729] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83c7d1777448493f8d4225ba660486d0, State: Initialized, Role: FOLLOWER
I20260928 20:17:21.616926 6349 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.617233 6466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.617305 6349 sys_catalog.cc:564] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:21.617465 6466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:17:21.620641 6477 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:17:21.620749 6477 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:17:21.621833 6281 master_runner.cc:263] No leader master found from master 83c7d1777448493f8d4225ba660486d0
I20260928 20:17:21.621881 6281 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:17:21.670599 6445 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:21.670727 6445 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.670951 6445 leader_election.cc:288] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1723d3e51e524717897856efb2e8642c (127.24.190.62:43073), 83c7d1777448493f8d4225ba660486d0 (127.24.190.61:45669)
I20260928 20:17:21.671458 6323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c7d1777448493f8d4225ba660486d0" is_pre_election: true
I20260928 20:17:21.671614 6323 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4773a6d19544339ba4bddd7ec2e67cf in term 0.
I20260928 20:17:21.671947 6248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1723d3e51e524717897856efb2e8642c" is_pre_election: true
I20260928 20:17:21.672079 6248 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c4773a6d19544339ba4bddd7ec2e67cf in term 0.
I20260928 20:17:21.672317 6374 leader_election.cc:302] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c7d1777448493f8d4225ba660486d0, c4773a6d19544339ba4bddd7ec2e67cf; no voters:
I20260928 20:17:21.672485 6445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:17:21.672531 6445 raft_consensus.cc:482] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:17:21.672554 6445 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:21.673434 6445 raft_consensus.cc:504] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.673545 6445 leader_election.cc:288] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [CANDIDATE]: Term 1 election: Requested vote from peers 1723d3e51e524717897856efb2e8642c (127.24.190.62:43073), 83c7d1777448493f8d4225ba660486d0 (127.24.190.61:45669)
I20260928 20:17:21.673949 6248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1723d3e51e524717897856efb2e8642c"
I20260928 20:17:21.674021 6248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:21.674896 6248 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4773a6d19544339ba4bddd7ec2e67cf in term 1.
I20260928 20:17:21.675212 6323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "83c7d1777448493f8d4225ba660486d0"
I20260928 20:17:21.675288 6323 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:21.676045 6323 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c4773a6d19544339ba4bddd7ec2e67cf in term 1.
I20260928 20:17:21.676255 6374 leader_election.cc:302] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 83c7d1777448493f8d4225ba660486d0, c4773a6d19544339ba4bddd7ec2e67cf; no voters:
I20260928 20:17:21.676473 6445 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:21.676630 6445 raft_consensus.cc:686] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [term 1 LEADER]: Becoming Leader. State: Replica: c4773a6d19544339ba4bddd7ec2e67cf, State: Running, Role: LEADER
I20260928 20:17:21.676712 6445 consensus_queue.cc:237] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } }
I20260928 20:17:21.677085 6445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4773a6d19544339ba4bddd7ec2e67cf. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.677148 6445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:21.677453 6481 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:21.677652 6481 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:21.679522 6323 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [term 1 FOLLOWER]: Refusing update from remote peer c4773a6d19544339ba4bddd7ec2e67cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:21.679875 6445 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:21.681047 6466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4773a6d19544339ba4bddd7ec2e67cf. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.681128 6466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:17:21.681555 6248 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [term 1 FOLLOWER]: Refusing update from remote peer c4773a6d19544339ba4bddd7ec2e67cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:21.681869 6445 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:21.683995 6431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c4773a6d19544339ba4bddd7ec2e67cf. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.684108 6431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:17:21.686249 6445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.686431 6445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:21.686622 6482 mvcc.cc:205] Tried to move back new op lower bound from 7334406724317425664 to 7334406724308451328. Current Snapshot: MvccSnapshot[applied={T|T < 7334406724317425664}]
I20260928 20:17:21.686851 6445 sys_catalog.cc:455] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.686847 6466 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.686914 6466 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:17:21.686914 6445 sys_catalog.cc:458] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:21.687515 6485 mvcc.cc:205] Tried to move back new op lower bound from 7334406724317425664 to 7334406724308451328. Current Snapshot: MvccSnapshot[applied={T|T < 7334406724317425664}]
I20260928 20:17:21.687669 6431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1723d3e51e524717897856efb2e8642c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43073 } } peers { permanent_uuid: "83c7d1777448493f8d4225ba660486d0" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 45669 } } peers { permanent_uuid: "c4773a6d19544339ba4bddd7ec2e67cf" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 38759 } } }
I20260928 20:17:21.687734 6431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:17:21.690680 6483 mvcc.cc:205] Tried to move back new op lower bound from 7334406724317425664 to 7334406724308451328. Current Snapshot: MvccSnapshot[applied={T|T < 7334406724317425664}]
I20260928 20:17:21.690815 6481 catalog_manager.cc:1347] Generated new cluster ID: a6fc6dcf392c4ddda1b08f70ba561ff5
I20260928 20:17:21.690867 6481 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:17:21.716861 6481 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:17:21.717700 6481 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:21.730749 6481 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c4773a6d19544339ba4bddd7ec2e67cf: Generated new TSK 0
I20260928 20:17:21.731056 6481 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:17:22.566421 6442 catalog_manager.cc:1259] Loaded cluster ID: a6fc6dcf392c4ddda1b08f70ba561ff5
I20260928 20:17:22.566500 6442 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: loading cluster ID for follower catalog manager: success
I20260928 20:17:22.567360 6442 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: acquiring CA information for follower catalog manager: success
I20260928 20:17:22.567684 6442 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1723d3e51e524717897856efb2e8642c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:17:22.621336 6477 catalog_manager.cc:1259] Loaded cluster ID: a6fc6dcf392c4ddda1b08f70ba561ff5
I20260928 20:17:22.621443 6477 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: loading cluster ID for follower catalog manager: success
I20260928 20:17:22.622255 6477 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: acquiring CA information for follower catalog manager: success
I20260928 20:17:22.622601 6477 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 83c7d1777448493f8d4225ba660486d0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:17:22.793068 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6206
I20260928 20:17:22.798555 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6281
I20260928 20:17:22.803440 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6356
2026-09-28T20:17:22Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (2945 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:17:22 dist-test-slave-n45k krb5kdc[6498](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:17:22 dist-test-slave-n45k krb5kdc[6498](info): set up 2 sockets
Sep 28 20:17:22 dist-test-slave-n45k krb5kdc[6498](info): commencing operation
krb5kdc: starting...
W20260928 20:17:23.866804 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.044s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:17:23 dist-test-slave-n45k krb5kdc[6498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:17:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:17:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:17:23.993903 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37631
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:39219
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:37631
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:24.075109 6511 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:24.075346 6511 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:24.075383 6511 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:24.076540 6511 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:24.076613 6511 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:24.076637 6511 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:24.076666 6511 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:24.076696 6511 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:24.078136 6511 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:39219
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:37631
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37631
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6511
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:24.078413 6511 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:24.078631 6511 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:24.083480 6516 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:24.083485 6517 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:24.083480 6519 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:24.083909 6511 server_base.cc:1034] running on GCE node
I20260928 20:17:24.084162 6511 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:24.084427 6511 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:24.085601 6511 hybrid_clock.cc:648] HybridClock initialized: now 1790626644085588 us; error 31 us; skew 500 ppm
Sep 28 20:17:24 dist-test-slave-n45k krb5kdc[6498](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626644, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:24.088248 6511 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:24.088719 6511 webserver.cc:460] Webserver started at http://127.24.190.62:44907/ using document root <none> and password file <none>
I20260928 20:17:24.088956 6511 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:24.089025 6511 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:24.089167 6511 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:24.090242 6511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf"
format_stamp: "Formatted at 2026-09-28 20:17:24 on dist-test-slave-n45k"
server_key: "ffcaae4d71d27fefad9515aebf7e7b0c"
server_key_iv: "331cf4d2ddd1bdb4e2a96487eb025c76"
server_key_version: "encryptionkey@0"
I20260928 20:17:24.090667 6511 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf"
format_stamp: "Formatted at 2026-09-28 20:17:24 on dist-test-slave-n45k"
server_key: "ffcaae4d71d27fefad9515aebf7e7b0c"
server_key_iv: "331cf4d2ddd1bdb4e2a96487eb025c76"
server_key_version: "encryptionkey@0"
I20260928 20:17:24.092010 6511 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:24.092796 6526 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:24.092978 6511 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:24.093067 6511 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf"
format_stamp: "Formatted at 2026-09-28 20:17:24 on dist-test-slave-n45k"
server_key: "ffcaae4d71d27fefad9515aebf7e7b0c"
server_key_iv: "331cf4d2ddd1bdb4e2a96487eb025c76"
server_key_version: "encryptionkey@0"
I20260928 20:17:24.093154 6511 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:24.114087 6511 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:24.116060 6511 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:24.116228 6511 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:24.120640 6511 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:37631
I20260928 20:17:24.120677 6578 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:37631 every 8 connection(s)
I20260928 20:17:24.121073 6511 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:24.121968 6579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:24.124433 6579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf: Bootstrap starting.
I20260928 20:17:24.125015 6579 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:24.125303 6579 log.cc:824] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:24.126004 6579 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf: No bootstrap required, opened a new log
I20260928 20:17:24.127765 6579 raft_consensus.cc:348] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37631 } }
I20260928 20:17:24.127904 6579 raft_consensus.cc:374] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:24.127926 6579 raft_consensus.cc:729] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d23d27ed1c0e4cbc8c4b65ccf746eadf, State: Initialized, Role: FOLLOWER
I20260928 20:17:24.128085 6579 consensus_queue.cc:260] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37631 } }
I20260928 20:17:24.128144 6579 raft_consensus.cc:388] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:24.128192 6579 raft_consensus.cc:482] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:24.128266 6579 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:24.128796 6579 raft_consensus.cc:504] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37631 } }
I20260928 20:17:24.128902 6579 leader_election.cc:302] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d23d27ed1c0e4cbc8c4b65ccf746eadf; no voters:
I20260928 20:17:24.129112 6579 leader_election.cc:288] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:17:24.129153 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6511
I20260928 20:17:24.129142 6582 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:24.129253 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:17:24.129349 6582 raft_consensus.cc:686] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [term 1 LEADER]: Becoming Leader. State: Replica: d23d27ed1c0e4cbc8c4b65ccf746eadf, State: Running, Role: LEADER
I20260928 20:17:24.129388 6579 sys_catalog.cc:564] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:24.129446 25336 external_mini_cluster.cc:1428] Setting key d5e084675bf855c587bf3f8495545126
I20260928 20:17:24.129544 6582 consensus_queue.cc:237] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37631 } }
I20260928 20:17:24.130127 6584 sys_catalog.cc:455] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37631 } } }
I20260928 20:17:24.130426 6584 sys_catalog.cc:458] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:24.130352 6583 sys_catalog.cc:455] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [sys.catalog]: SysCatalogTable state changed. Reason: New leader d23d27ed1c0e4cbc8c4b65ccf746eadf. Latest consensus state: current_term: 1 leader_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d23d27ed1c0e4cbc8c4b65ccf746eadf" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37631 } } }
I20260928 20:17:24.130702 6583 sys_catalog.cc:458] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:24.130873 6594 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:24.131440 6594 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:24.133057 6594 catalog_manager.cc:1347] Generated new cluster ID: d98018202faa43e3be1948608bdd537f
I20260928 20:17:24.133114 6594 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:17:24 dist-test-slave-n45k krb5kdc[6498](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626643, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:24.140527 6587 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:24.129917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52584 (local address 127.24.190.62:37631)
0928 20:17:24.130297 (+ 380us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:24.130305 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:24.130337 (+ 32us) server_negotiation.cc:407] Connection header received
0928 20:17:24.130458 (+ 121us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:24.130464 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:24.130520 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:24.131207 (+ 687us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:24.131493 (+ 286us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:24.132684 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:24.133633 (+ 949us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:24.134069 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:24.134200 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:24.136577 (+ 2377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:24.136581 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:24.136581 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:24.136592 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:24.138854 (+ 2262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:24.139227 (+ 373us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:24.139230 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:24.139231 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:24.139336 (+ 105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:24.139563 (+ 227us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:24.139564 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:24.139565 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:24.139818 (+ 253us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:24.139982 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:24.140098 (+ 116us) server_negotiation.cc:299] Negotiation successful
0928 20:17:24.140354 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":82,"threads_started":1}
I20260928 20:17:24.141556 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:17:24.147567 6594 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:17:24.148087 6594 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:24.156338 6594 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d23d27ed1c0e4cbc8c4b65ccf746eadf: Generated new TSK 0
I20260928 20:17:24.156533 6594 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:17:24.195640 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6511
2026-09-28T20:17:24Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (1390 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:17:24 dist-test-slave-n45k krb5kdc[6606](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:17:24 dist-test-slave-n45k krb5kdc[6606](info): set up 2 sockets
Sep 28 20:17:24 dist-test-slave-n45k krb5kdc[6606](info): commencing operation
krb5kdc: starting...
W20260928 20:17:25.238860 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:17:25Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:17:25Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:17:25.357852 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42573
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:42573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:25.439033 6619 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:25.439298 6619 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:25.439337 6619 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:25.440510 6619 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:25.440580 6619 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:25.440604 6619 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:25.440624 6619 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:25.440651 6619 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:25.442114 6619 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:42573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6619
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:25.442418 6619 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:25.442648 6619 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:25.447736 6627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:25.447757 6624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:25.447780 6619 server_base.cc:1034] running on GCE node
W20260928 20:17:25.447748 6625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:25.448213 6619 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:25.448457 6619 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:25.449664 6619 hybrid_clock.cc:648] HybridClock initialized: now 1790626645449654 us; error 36 us; skew 500 ppm
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:25.452241 6619 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:25.452700 6619 webserver.cc:460] Webserver started at http://127.24.190.62:41231/ using document root <none> and password file <none>
I20260928 20:17:25.452917 6619 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:25.452961 6619 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:25.453118 6619 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:25.454231 6619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "57f1e08def4d49a9b3a93a4abd20f3fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "637f96cee49b11acecdf38fa5adb059b"
server_key_iv: "f406ddc4653ef1a3003a39546cd48bd1"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.454702 6619 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "57f1e08def4d49a9b3a93a4abd20f3fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "637f96cee49b11acecdf38fa5adb059b"
server_key_iv: "f406ddc4653ef1a3003a39546cd48bd1"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.456025 6619 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:25.456756 6634 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.456919 6619 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:25.457006 6619 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "57f1e08def4d49a9b3a93a4abd20f3fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "637f96cee49b11acecdf38fa5adb059b"
server_key_iv: "f406ddc4653ef1a3003a39546cd48bd1"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.457067 6619 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:25.470767 6619 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:25.472884 6619 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:25.473013 6619 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:25.477314 6619 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:42573
I20260928 20:17:25.477347 6686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:42573 every 8 connection(s)
I20260928 20:17:25.477728 6619 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:25.478772 6687 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:25.481025 6687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap starting.
I20260928 20:17:25.481587 6687 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:25.481885 6687 log.cc:824] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:25.482615 6687 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: No bootstrap required, opened a new log
I20260928 20:17:25.482816 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6619
I20260928 20:17:25.482921 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:17:25.483112 25336 external_mini_cluster.cc:1428] Setting key 4955bce4ceb13b86c6f512d070f12fb1
I20260928 20:17:25.484879 6687 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:25.485059 6687 raft_consensus.cc:374] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:25.485098 6687 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f1e08def4d49a9b3a93a4abd20f3fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:25.485263 6687 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:25.485332 6687 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:25.485353 6687 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:25.485421 6687 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:25.486570 6687 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:25.486690 6687 leader_election.cc:302] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57f1e08def4d49a9b3a93a4abd20f3fd; no voters:
I20260928 20:17:25.486852 6687 leader_election.cc:288] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:17:25.486910 6692 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:25.487082 6687 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:25.487084 6692 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 LEADER]: Becoming Leader. State: Replica: 57f1e08def4d49a9b3a93a4abd20f3fd, State: Running, Role: LEADER
I20260928 20:17:25.487309 6692 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:25.487716 6693 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } } }
I20260928 20:17:25.487704 6694 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57f1e08def4d49a9b3a93a4abd20f3fd. Latest consensus state: current_term: 1 leader_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } } }
I20260928 20:17:25.487807 6693 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:25.487810 6694 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:25.488608 6701 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:25.489619 6701 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:25.491302 6701 catalog_manager.cc:1347] Generated new cluster ID: f4ca78cb737a4d0b9161459e2b841e7c
I20260928 20:17:25.491362 6701 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:25.496140 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:25.483629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55898 (local address 127.24.190.62:42573)
0928 20:17:25.483838 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:25.483848 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:25.483883 (+ 35us) server_negotiation.cc:407] Connection header received
0928 20:17:25.484835 (+ 952us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:25.484844 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:25.484910 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:25.485059 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:25.485879 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.487291 (+ 1412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.488669 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.489212 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.489316 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:25.492087 (+ 2771us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:25.492090 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:25.492091 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:25.492102 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:25.494105 (+ 2003us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:25.494555 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:25.494558 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:25.494558 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:25.494681 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:25.494892 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:25.494893 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:25.494893 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:25.495181 (+ 288us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:25.495732 (+ 551us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:25.495799 (+ 67us) server_negotiation.cc:299] Negotiation successful
0928 20:17:25.495934 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":89,"threads_started":1}
I20260928 20:17:25.516454 6701 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:17:25.517061 6701 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:25.522987 6701 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Generated new TSK 0
I20260928 20:17:25.523191 6701 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:17:25.557353 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42573
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:25.638828 6713 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:25.639039 6713 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:25.639063 6713 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:25.640249 6713 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:25.640306 6713 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:25.640358 6713 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:17:25.641954 6713 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6713
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:25.642212 6713 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:25.642484 6713 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:25.647629 6721 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:25.647608 6719 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:25.647600 6718 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:25.647835 6713 server_base.cc:1034] running on GCE node
I20260928 20:17:25.648139 6713 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:25.648420 6713 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:25.649590 6713 hybrid_clock.cc:648] HybridClock initialized: now 1790626645649579 us; error 28 us; skew 500 ppm
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:25.652259 6713 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:17:25.652796 6713 webserver.cc:460] Webserver started at http://127.24.190.1:38209/ using document root <none> and password file <none>
I20260928 20:17:25.653067 6713 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:25.653141 6713 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:25.653302 6713 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:25.654546 6713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "c6630a8999d34a98b97f557a544221fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "54db0a9c2cc43482552dc1318dbbaf97"
server_key_iv: "a3b7fe89e6dc4674ec89fb9483265d01"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.654933 6713 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "c6630a8999d34a98b97f557a544221fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "54db0a9c2cc43482552dc1318dbbaf97"
server_key_iv: "a3b7fe89e6dc4674ec89fb9483265d01"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.656728 6713 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s
I20260928 20:17:25.657570 6728 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.657743 6713 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:25.657850 6713 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c6630a8999d34a98b97f557a544221fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "54db0a9c2cc43482552dc1318dbbaf97"
server_key_iv: "a3b7fe89e6dc4674ec89fb9483265d01"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.657943 6713 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:25.687237 6713 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:25.689950 6713 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:25.690141 6713 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:25.690428 6713 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:25.690788 6713 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:25.690845 6713 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.690899 6713 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:25.690935 6713 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.697110 6713 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:36375
I20260928 20:17:25.697190 6841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:36375 every 8 connection(s)
I20260928 20:17:25.697582 6713 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:17:25.702507 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6713
I20260928 20:17:25.702661 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:17:25.702864 25336 external_mini_cluster.cc:1428] Setting key 7ef120b606ee1ea87f07eb1ba79185bd
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:25.708436 6844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:25.698395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:46947)
0928 20:17:25.698542 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:25.698579 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:25.699118 (+ 539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:25.699378 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:25.699383 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:25.699964 (+ 581us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:25.700165 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:25.700170 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.700884 (+ 714us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.700886 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:25.701686 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:25.701688 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.702090 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.702091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:25.702219 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:25.702860 (+ 641us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:25.702868 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:25.704835 (+ 1967us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:25.706991 (+ 2156us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:25.706997 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:25.706999 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:25.707255 (+ 256us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:25.707473 (+ 218us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:25.707474 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:25.707474 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:25.707621 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:25.707938 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:25.707943 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:25.708067 (+ 124us) client_negotiation.cc:769] Sending connection context
0928 20:17:25.708147 (+ 80us) client_negotiation.cc:240] Negotiation successful
0928 20:17:25.708273 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":70,"threads_started":1}
I20260928 20:17:25.708448 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:25.698413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:46947 (local address 127.24.190.62:42573)
0928 20:17:25.698459 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:25.698461 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:25.698670 (+ 209us) server_negotiation.cc:407] Connection header received
0928 20:17:25.699225 (+ 555us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:25.699226 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:25.699244 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:25.699315 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:25.700269 (+ 954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.700781 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.701778 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.701993 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.702078 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:25.704951 (+ 2873us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:25.704953 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:25.704953 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:25.704960 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:25.706893 (+ 1933us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:25.707335 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:25.707336 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:25.707337 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:25.707404 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:25.707702 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:25.707703 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:25.707703 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:25.707864 (+ 161us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:25.707936 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:25.708202 (+ 266us) server_negotiation.cc:299] Negotiation successful
0928 20:17:25.708301 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:17:25.709107 6842 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42573
I20260928 20:17:25.709220 6842 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:25.709431 6842 heartbeater.cc:511] Master 127.24.190.62:42573 requested a full tablet report, sending...
I20260928 20:17:25.710058 6651 ts_manager.cc:194] Registered new tserver with Master: c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375)
I20260928 20:17:25.711058 6651 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:46947
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:17:25.731767 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42573
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:25.813620 6847 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:25.813838 6847 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:25.813862 6847 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:25.815125 6847 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:25.815171 6847 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:25.815198 6847 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:17:25.816654 6847 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6847
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:25.816905 6847 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:25.817133 6847 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:25.822294 6855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:25.822290 6852 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:25.822324 6853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:25.822641 6847 server_base.cc:1034] running on GCE node
I20260928 20:17:25.822842 6847 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:25.823084 6847 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:25.824240 6847 hybrid_clock.cc:648] HybridClock initialized: now 1790626645824228 us; error 32 us; skew 500 ppm
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:25.826848 6847 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:17:25.827360 6847 webserver.cc:460] Webserver started at http://127.24.190.2:38303/ using document root <none> and password file <none>
I20260928 20:17:25.827603 6847 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:25.827668 6847 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:25.827800 6847 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:25.828833 6847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "e6bb2d42b3eb43e7a798435b23ec1479"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "cd0bd1174bbd12aa5f5eb8eaec167a60"
server_key_iv: "ddd04042d58ba9bbedb204cf86b41d00"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.829190 6847 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "e6bb2d42b3eb43e7a798435b23ec1479"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "cd0bd1174bbd12aa5f5eb8eaec167a60"
server_key_iv: "ddd04042d58ba9bbedb204cf86b41d00"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.830763 6847 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260928 20:17:25.831547 6862 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.831727 6847 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:25.831837 6847 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "e6bb2d42b3eb43e7a798435b23ec1479"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "cd0bd1174bbd12aa5f5eb8eaec167a60"
server_key_iv: "ddd04042d58ba9bbedb204cf86b41d00"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.831909 6847 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:25.853193 6847 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:25.855361 6847 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:25.855522 6847 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:25.855763 6847 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:25.856081 6847 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:25.856132 6847 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.856174 6847 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:25.856204 6847 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.862506 6847 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:38809
I20260928 20:17:25.862547 6975 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:38809 every 8 connection(s)
I20260928 20:17:25.862921 6847 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:17:25.866777 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6847
I20260928 20:17:25.866863 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:17:25.867061 25336 external_mini_cluster.cc:1428] Setting key e721fb3d61973880757492c0c63c504a
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:25.873116 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:25.863669 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:49311 (local address 127.24.190.62:42573)
0928 20:17:25.863715 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:25.863717 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:25.863905 (+ 188us) server_negotiation.cc:407] Connection header received
0928 20:17:25.864438 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:25.864439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:25.864453 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:25.864512 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:25.865467 (+ 955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.865985 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.867179 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.867457 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.867532 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:25.869916 (+ 2384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:25.869918 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:25.869918 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:25.869927 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:25.871450 (+ 1523us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:25.871999 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:25.871999 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:25.872000 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:25.872050 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:25.872365 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:25.872366 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:25.872366 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:25.872472 (+ 106us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:25.872525 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:25.872898 (+ 373us) server_negotiation.cc:299] Negotiation successful
0928 20:17:25.873011 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:17:25.873430 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:25.863633 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:49311)
0928 20:17:25.863777 (+ 144us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:25.863826 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:25.864326 (+ 500us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:25.864584 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:25.864587 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:25.865174 (+ 587us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:25.865370 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:25.865375 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.866084 (+ 709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.866085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:25.867054 (+ 969us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:25.867057 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:25.867541 (+ 484us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:25.867542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:25.867677 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:25.868187 (+ 510us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:25.868194 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:25.869820 (+ 1626us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:25.871530 (+ 1710us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:25.871538 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:25.871541 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:25.871915 (+ 374us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:25.872119 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:25.872120 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:25.872121 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:25.872284 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:25.872541 (+ 257us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:25.872548 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:25.872743 (+ 195us) client_negotiation.cc:769] Sending connection context
0928 20:17:25.872887 (+ 144us) client_negotiation.cc:240] Negotiation successful
0928 20:17:25.873115 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":73,"threads_started":1}
I20260928 20:17:25.873965 6976 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42573
I20260928 20:17:25.874073 6976 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:25.874254 6976 heartbeater.cc:511] Master 127.24.190.62:42573 requested a full tablet report, sending...
I20260928 20:17:25.874796 6651 ts_manager.cc:194] Registered new tserver with Master: e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
I20260928 20:17:25.875177 6651 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:49311
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:17:25.893566 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42573
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:25.978193 6981 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:25.978422 6981 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:25.978446 6981 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:25.979588 6981 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:25.979630 6981 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:25.979681 6981 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:17:25.981127 6981 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.6981
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:25.981382 6981 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:25.981606 6981 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:25.986565 6986 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:25.986577 6989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:25.986693 6981 server_base.cc:1034] running on GCE node
W20260928 20:17:25.986667 6987 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:25.987082 6981 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:25.987336 6981 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:25.988517 6981 hybrid_clock.cc:648] HybridClock initialized: now 1790626645988508 us; error 30 us; skew 500 ppm
Sep 28 20:17:25 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:25.991106 6981 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:17:25.991593 6981 webserver.cc:460] Webserver started at http://127.24.190.3:44741/ using document root <none> and password file <none>
I20260928 20:17:25.991822 6981 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:25.991886 6981 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:25.992026 6981 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:25.993045 6981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "810ef3376e6b42a49934fd5e7a638aa7"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "982488b3a0fbcb1b9c905001e20f5501"
server_key_iv: "1cd64d0d3460359cb783e27ef614819b"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.993413 6981 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "810ef3376e6b42a49934fd5e7a638aa7"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "982488b3a0fbcb1b9c905001e20f5501"
server_key_iv: "1cd64d0d3460359cb783e27ef614819b"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.994783 6981 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:17:25.995551 6996 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:25.995766 6981 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:25.995901 6981 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "810ef3376e6b42a49934fd5e7a638aa7"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "982488b3a0fbcb1b9c905001e20f5501"
server_key_iv: "1cd64d0d3460359cb783e27ef614819b"
server_key_version: "encryptionkey@0"
I20260928 20:17:25.995970 6981 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:26.009737 6981 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:26.012022 6981 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:26.012184 6981 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:26.012430 6981 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:26.012734 6981 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:26.012784 6981 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.012818 6981 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:26.012845 6981 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.018807 6981 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36891
I20260928 20:17:26.018853 7109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36891 every 8 connection(s)
I20260928 20:17:26.019174 6981 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626645, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:26.028733 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 6981
I20260928 20:17:26.028846 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:17:26.028923 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.020019 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:39899 (local address 127.24.190.62:42573)
0928 20:17:26.020119 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.020122 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.020300 (+ 178us) server_negotiation.cc:407] Connection header received
0928 20:17:26.020861 (+ 561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.020863 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.020875 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.020930 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.021904 (+ 974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.022490 (+ 586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.023691 (+ 1201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.023890 (+ 199us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.023973 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.026079 (+ 2106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.026080 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.026081 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.026089 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.027367 (+ 1278us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.027758 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.027759 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.027760 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.027827 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.028070 (+ 243us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.028071 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.028071 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.028190 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.028264 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.028729 (+ 465us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.028828 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260928 20:17:26.029024 25336 external_mini_cluster.cc:1428] Setting key b20ea2998ad1e131b6ba7a2bc8257f2b
I20260928 20:17:26.029207 7112 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.019933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:39899)
0928 20:17:26.020152 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.020208 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.020738 (+ 530us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.021002 (+ 264us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.021006 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.021582 (+ 576us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:26.021772 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.021777 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.022579 (+ 802us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.022580 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.023585 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.023588 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.023983 (+ 395us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.023984 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.024106 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.024588 (+ 482us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:26.024596 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:26.025980 (+ 1384us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:26.027450 (+ 1470us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.027457 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.027460 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.027684 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.027891 (+ 207us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.027892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.027893 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.027998 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.028253 (+ 255us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:26.028259 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:26.028519 (+ 260us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.028696 (+ 177us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.028865 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":83,"threads_started":1}
I20260928 20:17:26.029745 7110 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42573
I20260928 20:17:26.029848 7110 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:26.030061 7110 heartbeater.cc:511] Master 127.24.190.62:42573 requested a full tablet report, sending...
I20260928 20:17:26.030479 6651 ts_manager.cc:194] Registered new tserver with Master: 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891)
I20260928 20:17:26.030864 6651 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:39899
I20260928 20:17:26.040948 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:17:26.048110 6691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.042254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55906 (local address 127.24.190.62:42573)
0928 20:17:26.042346 (+ 92us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.042348 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.042402 (+ 54us) server_negotiation.cc:407] Connection header received
0928 20:17:26.042459 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.042460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.042469 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.042515 (+ 46us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.043068 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.043542 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.044246 (+ 704us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.044480 (+ 234us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.044537 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.045656 (+ 1119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.045657 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.045657 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.045664 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.047132 (+ 1468us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.047443 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.047444 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.047444 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.047494 (+ 50us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.047648 (+ 154us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.047649 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.047649 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.047806 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.047880 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.047960 (+ 80us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.048018 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260928 20:17:26.049593 6651 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55906:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:17:26.051235 6651 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:17:26.057729 7122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.053686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37264 (local address 127.24.190.2:38809)
0928 20:17:26.054113 (+ 427us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.054117 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.054126 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:17:26.054179 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.054181 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.054206 (+ 25us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.054316 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.054611 (+ 295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.055579 (+ 968us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.056773 (+ 1194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.057295 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.057390 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.057452 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.057603 (+ 151us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.057643 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":396,"thread_start_us":112,"threads_started":1}
I20260928 20:17:26.057720 7121 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.053553 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:38809 (local address 127.0.0.1:37264)
0928 20:17:26.053674 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.053717 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.053802 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.054377 (+ 575us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.054381 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.054383 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.054477 (+ 94us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.054479 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.055686 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.055688 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.056682 (+ 994us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.056684 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.057395 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.057396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.057477 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.057491 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.057586 (+ 95us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.057643 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":89,"thread_start_us":51,"threads_started":1}
I20260928 20:17:26.058820 7123 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.053765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:36375 (local address 127.0.0.1:42202)
0928 20:17:26.054451 (+ 686us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.054460 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.054503 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.054698 (+ 195us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.054699 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.054701 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.054748 (+ 47us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.054750 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.056276 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.056277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.057559 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.057562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.058565 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.058566 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.058629 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.058634 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.058687 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.058737 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":80,"thread_start_us":74,"threads_started":1}
I20260928 20:17:26.058699 6910 tablet_service.cc:1467] Processing CreateTablet for tablet 8a06e30766d449cc839a44ae778bcd25 (DEFAULT_TABLE table=test-table [id=a98ecf7a2f4a43e8a06cf0fff7af4f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:26.058926 7126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.054038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34168 (local address 127.24.190.3:36891)
0928 20:17:26.054574 (+ 536us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.054578 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.054693 (+ 115us) server_negotiation.cc:407] Connection header received
0928 20:17:26.054835 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.054838 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.054854 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.054924 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.055098 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.056159 (+ 1061us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.057665 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.058400 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.058471 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.058528 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.058809 (+ 281us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.058854 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":502,"thread_start_us":303,"threads_started":1}
I20260928 20:17:26.059057 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.053891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42202 (local address 127.24.190.1:36375)
0928 20:17:26.054480 (+ 589us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.054485 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.054496 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:17:26.054584 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.054587 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.054602 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.054694 (+ 92us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.054984 (+ 290us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.056151 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.057657 (+ 1506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.058400 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.058469 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.058528 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.058936 (+ 408us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.058982 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":102,"threads_started":1}
I20260928 20:17:26.059099 6910 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a06e30766d449cc839a44ae778bcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:26.059134 7125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.053934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36891 (local address 127.0.0.1:34168)
0928 20:17:26.054629 (+ 695us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.054640 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.054719 (+ 79us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.054965 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.054967 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.054969 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.055011 (+ 42us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.055012 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.056276 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.056277 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.057559 (+ 1282us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.057562 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.058639 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.058640 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.058704 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.058709 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.058999 (+ 290us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.059056 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":674,"mutex_wait_us":88,"thread_start_us":63,"threads_started":1}
I20260928 20:17:26.061897 7127 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Bootstrap starting.
I20260928 20:17:26.062686 7127 tablet_bootstrap.cc:654] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:26.062741 7044 tablet_service.cc:1467] Processing CreateTablet for tablet 8a06e30766d449cc839a44ae778bcd25 (DEFAULT_TABLE table=test-table [id=a98ecf7a2f4a43e8a06cf0fff7af4f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:26.063077 7044 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a06e30766d449cc839a44ae778bcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:26.063261 7127 log.cc:824] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.063956 7127 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: No bootstrap required, opened a new log
I20260928 20:17:26.064043 7127 ts_tablet_manager.cc:1397] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:17:26.065587 7127 raft_consensus.cc:348] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.065714 7129 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Bootstrap starting.
I20260928 20:17:26.065747 7127 raft_consensus.cc:374] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:26.065790 7127 raft_consensus.cc:729] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6bb2d42b3eb43e7a798435b23ec1479, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.065939 7127 consensus_queue.cc:260] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.066220 6976 heartbeater.cc:503] Master 127.24.190.62:42573 was elected leader, sending a full tablet report...
I20260928 20:17:26.066162 6776 tablet_service.cc:1467] Processing CreateTablet for tablet 8a06e30766d449cc839a44ae778bcd25 (DEFAULT_TABLE table=test-table [id=a98ecf7a2f4a43e8a06cf0fff7af4f89]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:26.066222 7127 ts_tablet_manager.cc:1428] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:17:26.066445 7129 tablet_bootstrap.cc:654] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:26.066515 6776 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8a06e30766d449cc839a44ae778bcd25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:26.066967 7129 log.cc:824] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.069054 7132 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Bootstrap starting.
I20260928 20:17:26.069633 7129 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: No bootstrap required, opened a new log
I20260928 20:17:26.069687 7129 ts_tablet_manager.cc:1397] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s
I20260928 20:17:26.069660 7132 tablet_bootstrap.cc:654] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:26.070134 7132 log.cc:824] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.070842 7132 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: No bootstrap required, opened a new log
I20260928 20:17:26.070917 7132 ts_tablet_manager.cc:1397] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:17:26.071097 7129 raft_consensus.cc:348] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.071219 7129 raft_consensus.cc:374] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:26.071240 7129 raft_consensus.cc:729] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810ef3376e6b42a49934fd5e7a638aa7, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.071372 7129 consensus_queue.cc:260] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.071611 7129 ts_tablet_manager.cc:1428] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s
I20260928 20:17:26.071661 7110 heartbeater.cc:503] Master 127.24.190.62:42573 was elected leader, sending a full tablet report...
I20260928 20:17:26.072793 7132 raft_consensus.cc:348] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.072928 7132 raft_consensus.cc:374] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:26.072973 7132 raft_consensus.cc:729] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6630a8999d34a98b97f557a544221fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.073100 7132 consensus_queue.cc:260] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.073371 7132 ts_tablet_manager.cc:1428] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:17:26.073401 6842 heartbeater.cc:503] Master 127.24.190.62:42573 was elected leader, sending a full tablet report...
W20260928 20:17:26.113528 6977 tablet.cc:2369] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:17:26.198396 6843 tablet.cc:2369] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:17:26.203514 7130 raft_consensus.cc:482] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:26.203627 7130 raft_consensus.cc:504] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.204042 7130 leader_election.cc:288] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375), 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891)
I20260928 20:17:26.206955 6978 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.204214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:36375 (local address 127.24.190.2:35415)
0928 20:17:26.204280 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.204293 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.204368 (+ 75us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.204535 (+ 167us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.204536 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.204538 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.204610 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.204612 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.205349 (+ 737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.205350 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.206083 (+ 733us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.206085 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.206688 (+ 603us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.206689 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.206774 (+ 85us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.206778 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.206841 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.206884 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":40}
I20260928 20:17:26.206954 7124 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.204314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:35415 (local address 127.24.190.1:36375)
0928 20:17:26.204383 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.204385 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.204397 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:17:26.204429 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.204430 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.204444 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.204504 (+ 60us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.204689 (+ 185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.205264 (+ 575us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.206175 (+ 911us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.206605 (+ 430us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.206690 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.206699 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.206848 (+ 149us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.206884 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 20:17:26.207207 7126 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.204455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33681 (local address 127.24.190.3:36891)
0928 20:17:26.204514 (+ 59us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.204517 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.204642 (+ 125us) server_negotiation.cc:407] Connection header received
0928 20:17:26.204710 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.204711 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.204721 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.204771 (+ 50us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.204943 (+ 172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.205499 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.206426 (+ 927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.206814 (+ 388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.206903 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.206911 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.207089 (+ 178us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.207142 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 20:17:26.207337 6796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06e30766d449cc839a44ae778bcd25" candidate_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6630a8999d34a98b97f557a544221fd" is_pre_election: true
I20260928 20:17:26.207434 7136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.204341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36891 (local address 127.24.190.2:33681)
0928 20:17:26.204557 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.204589 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.204654 (+ 65us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.204780 (+ 126us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.204780 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.204782 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.204860 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.204862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.205590 (+ 728us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.205591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.206335 (+ 744us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.206336 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.206902 (+ 566us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.206903 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.206976 (+ 73us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.206980 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.207318 (+ 338us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.207362 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":200,"thread_start_us":132,"threads_started":1}
I20260928 20:17:26.207530 6796 raft_consensus.cc:2454] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6bb2d42b3eb43e7a798435b23ec1479 in term 0.
I20260928 20:17:26.207744 6866 leader_election.cc:302] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6630a8999d34a98b97f557a544221fd, e6bb2d42b3eb43e7a798435b23ec1479; no voters:
I20260928 20:17:26.207921 7130 raft_consensus.cc:2781] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:17:26.208000 7130 raft_consensus.cc:482] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:17:26.208048 7130 raft_consensus.cc:3037] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:26.208091 7064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06e30766d449cc839a44ae778bcd25" candidate_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810ef3376e6b42a49934fd5e7a638aa7" is_pre_election: true
I20260928 20:17:26.208261 7064 raft_consensus.cc:2454] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6bb2d42b3eb43e7a798435b23ec1479 in term 0.
I20260928 20:17:26.208868 7130 raft_consensus.cc:504] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.209005 7130 leader_election.cc:288] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [CANDIDATE]: Term 1 election: Requested vote from peers c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375), 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891)
I20260928 20:17:26.209188 7064 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06e30766d449cc839a44ae778bcd25" candidate_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810ef3376e6b42a49934fd5e7a638aa7"
I20260928 20:17:26.209173 6796 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a06e30766d449cc839a44ae778bcd25" candidate_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6630a8999d34a98b97f557a544221fd"
I20260928 20:17:26.209254 7064 raft_consensus.cc:3037] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:26.209255 6796 raft_consensus.cc:3037] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:26.210129 7064 raft_consensus.cc:2454] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6bb2d42b3eb43e7a798435b23ec1479 in term 1.
I20260928 20:17:26.210124 6796 raft_consensus.cc:2454] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6bb2d42b3eb43e7a798435b23ec1479 in term 1.
I20260928 20:17:26.210296 6866 leader_election.cc:302] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810ef3376e6b42a49934fd5e7a638aa7, e6bb2d42b3eb43e7a798435b23ec1479; no voters:
I20260928 20:17:26.210395 7130 raft_consensus.cc:2781] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:26.210563 7130 raft_consensus.cc:686] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 LEADER]: Becoming Leader. State: Replica: e6bb2d42b3eb43e7a798435b23ec1479, State: Running, Role: LEADER
I20260928 20:17:26.210662 7130 consensus_queue.cc:237] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.211457 6651 catalog_manager.cc:5495] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 reported cstate change: term changed from 0 to 1, leader changed from <none> to e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } health_report { overall_health: UNKNOWN } } }
I20260928 20:17:26.237366 7122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.235132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37276 (local address 127.24.190.2:38809)
0928 20:17:26.235186 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.235188 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.235207 (+ 19us) server_negotiation.cc:407] Connection header received
0928 20:17:26.235242 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.235243 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.235271 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.235334 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:17:26.235456 (+ 122us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.235975 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.236681 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.236875 (+ 194us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.236940 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.237058 (+ 118us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:17:26.237156 (+ 98us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:17:26.237258 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.237272 (+ 14us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.237289 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 20:17:26.239156 7064 raft_consensus.cc:1261] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Refusing update from remote peer e6bb2d42b3eb43e7a798435b23ec1479: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:26.239217 6796 raft_consensus.cc:1261] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Refusing update from remote peer e6bb2d42b3eb43e7a798435b23ec1479: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:26.239553 7130 consensus_queue.cc:1035] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:26.239686 7137 consensus_queue.cc:1035] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:26.242128 7141 mvcc.cc:205] Tried to move back new op lower bound from 7334406742992834560 to 7334406742879477760. Current Snapshot: MvccSnapshot[applied={T|T < 7334406742992834560}]
I20260928 20:17:26.242681 7142 mvcc.cc:205] Tried to move back new op lower bound from 7334406742992834560 to 7334406742879477760. Current Snapshot: MvccSnapshot[applied={T|T < 7334406742992834560}]
I20260928 20:17:26.244488 6651 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:26.244583 6651 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55906:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:26.245303 6651 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Sending DeleteTablet for 3 replicas of tablet 8a06e30766d449cc839a44ae778bcd25
I20260928 20:17:26.245708 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6713
I20260928 20:17:26.245699 7044 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06e30766d449cc839a44ae778bcd25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:26 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:34168
I20260928 20:17:26.245709 6910 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06e30766d449cc839a44ae778bcd25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:26 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:37264
I20260928 20:17:26.245922 7150 tablet_replica.cc:330] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: stopping tablet replica
I20260928 20:17:26.246018 7150 raft_consensus.cc:2229] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:17:26.246132 7150 raft_consensus.cc:2258] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:26.246583 7150 ts_tablet_manager.cc:1905] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:26.246588 7149 tablet_replica.cc:330] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: stopping tablet replica
I20260928 20:17:26.246685 7149 raft_consensus.cc:2229] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:17:26.246786 7149 raft_consensus.cc:2258] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:26.247236 7149 ts_tablet_manager.cc:1905] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:26.248293 7150 ts_tablet_manager.cc:1918] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:26.248358 7150 log.cc:1196] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/8a06e30766d449cc839a44ae778bcd25
I20260928 20:17:26.248629 7150 ts_tablet_manager.cc:1939] T 8a06e30766d449cc839a44ae778bcd25 P e6bb2d42b3eb43e7a798435b23ec1479: Deleting consensus metadata
I20260928 20:17:26.249001 6638 catalog_manager.cc:4841] TS e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): tablet 8a06e30766d449cc839a44ae778bcd25 (table test-table [id=a98ecf7a2f4a43e8a06cf0fff7af4f89]) successfully deleted
I20260928 20:17:26.249189 7149 ts_tablet_manager.cc:1918] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:26.249265 7149 log.cc:1196] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/8a06e30766d449cc839a44ae778bcd25
I20260928 20:17:26.249562 7149 ts_tablet_manager.cc:1939] T 8a06e30766d449cc839a44ae778bcd25 P 810ef3376e6b42a49934fd5e7a638aa7: Deleting consensus metadata
I20260928 20:17:26.250387 6638 catalog_manager.cc:4841] TS 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): tablet 8a06e30766d449cc839a44ae778bcd25 (table test-table [id=a98ecf7a2f4a43e8a06cf0fff7af4f89]) successfully deleted
W20260928 20:17:26.252568 6638 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:36375 (error 108)
I20260928 20:17:26.252791 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6847
I20260928 20:17:26.253487 7125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.252965 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:36375 (local address 127.0.0.1:42212)
0928 20:17:26.253415 (+ 450us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.253453 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:36375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":433}
W20260928 20:17:26.256564 6638 catalog_manager.cc:4584] TS c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8a06e30766d449cc839a44ae778bcd25: Network error: Client connection negotiation failed: client connection to 127.24.190.1:36375: connect: Connection refused (error 111)
I20260928 20:17:26.259935 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6981
I20260928 20:17:26.264487 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 6619
I20260928 20:17:26.269918 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42573
--webserver_interface=127.24.190.62
--webserver_port=41231
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:42573
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:26.351534 7152 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:26.351796 7152 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:26.351846 7152 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:26.353590 7152 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:26.353668 7152 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:26.353695 7152 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:26.353726 7152 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:26.353752 7152 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:26.355315 7152 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:42573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7152
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:26.355592 7152 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:26.355815 7152 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:26.364915 7161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.364946 7152 server_base.cc:1034] running on GCE node
W20260928 20:17:26.365012 7158 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:26.365114 7159 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.365461 7152 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:26.365792 7152 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:26.366954 7152 hybrid_clock.cc:648] HybridClock initialized: now 1790626646366946 us; error 33 us; skew 500 ppm
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:26.369391 7152 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:26.369859 7152 webserver.cc:460] Webserver started at http://127.24.190.62:41231/ using document root <none> and password file <none>
I20260928 20:17:26.370091 7152 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:26.370173 7152 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:26.371579 7152 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:26.372220 7168 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.372430 7152 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:26.372534 7152 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "57f1e08def4d49a9b3a93a4abd20f3fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "637f96cee49b11acecdf38fa5adb059b"
server_key_iv: "f406ddc4653ef1a3003a39546cd48bd1"
server_key_version: "encryptionkey@0"
I20260928 20:17:26.372939 7152 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:26.392108 7152 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:26.393972 7152 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:26.394131 7152 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:26.398224 7152 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:42573
I20260928 20:17:26.398344 7220 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:42573 every 8 connection(s)
I20260928 20:17:26.398710 7152 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:26.400382 7221 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:17:26.401067 7221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap starting.
I20260928 20:17:26.405133 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7152
I20260928 20:17:26.405486 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:36375
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:42573
--webserver_port=38209
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:26.410145 7221 log.cc:824] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.412206 7221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:17:26.412521 7221 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap complete.
I20260928 20:17:26.415037 7221 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:26.415304 7221 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f1e08def4d49a9b3a93a4abd20f3fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.415483 7221 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:26.415568 7221 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:26.415627 7221 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:26.415690 7221 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:17:26.416728 7221 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:26.416848 7221 leader_election.cc:302] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57f1e08def4d49a9b3a93a4abd20f3fd; no voters:
I20260928 20:17:26.417048 7221 leader_election.cc:288] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [CANDIDATE]: Term 2 election: Requested vote from peers
I20260928 20:17:26.417086 7225 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:17:26.417193 7225 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 LEADER]: Becoming Leader. State: Replica: 57f1e08def4d49a9b3a93a4abd20f3fd, State: Running, Role: LEADER
I20260928 20:17:26.417337 7221 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:26.417354 7225 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:26.417768 7226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } } }
I20260928 20:17:26.417858 7226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:26.418080 7227 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57f1e08def4d49a9b3a93a4abd20f3fd. Latest consensus state: current_term: 2 leader_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } } }
I20260928 20:17:26.418154 7227 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:26.418509 7232 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:26.419364 7232 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:26.419463 7232 catalog_manager.cc:1259] Loaded cluster ID: f4ca78cb737a4d0b9161459e2b841e7c
I20260928 20:17:26.419540 7232 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:17:26.419960 7232 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260928 20:17:26.424666 7232 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260928 20:17:26.427208 7232 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:26.427416 7232 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Loaded TSK: 0
I20260928 20:17:26.427636 7232 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 20:17:26.489667 7223 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:26.489897 7223 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:26.489935 7223 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:26.491184 7223 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:26.491250 7223 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:26.491295 7223 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:17:26.492722 7223 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:36375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=38209
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7223
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:26.492990 7223 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:26.493222 7223 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:26.498180 7248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:26.498209 7251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.498413 7223 server_base.cc:1034] running on GCE node
W20260928 20:17:26.498334 7249 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.498786 7223 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:26.499033 7223 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:26.500208 7223 hybrid_clock.cc:648] HybridClock initialized: now 1790626646500192 us; error 31 us; skew 500 ppm
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:26.502825 7223 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:17:26.503233 7223 webserver.cc:460] Webserver started at http://127.24.190.1:38209/ using document root <none> and password file <none>
I20260928 20:17:26.503453 7223 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:26.503531 7223 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:26.504980 7223 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s
I20260928 20:17:26.505800 7258 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.506102 7223 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:26.506203 7223 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c6630a8999d34a98b97f557a544221fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "54db0a9c2cc43482552dc1318dbbaf97"
server_key_iv: "a3b7fe89e6dc4674ec89fb9483265d01"
server_key_version: "encryptionkey@0"
I20260928 20:17:26.506613 7223 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:26.544414 7223 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:26.546839 7223 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:26.547008 7223 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:26.547338 7223 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:26.547782 7265 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 20:17:26.549238 7223 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 20:17:26.549311 7223 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260928 20:17:26.549357 7223 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 20:17:26.550052 7223 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 20:17:26.550105 7223 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260928 20:17:26.550171 7265 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Bootstrap starting.
I20260928 20:17:26.556734 7223 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:36375
I20260928 20:17:26.556831 7372 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:36375 every 8 connection(s)
I20260928 20:17:26.557166 7223 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:17:26.561060 7265 log.cc:824] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.561365 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7223
I20260928 20:17:26.561666 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:38809
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:42573
--webserver_port=38303
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:26.563833 7265 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:17:26.564455 7265 tablet_bootstrap.cc:492] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Bootstrap complete.
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:26.565514 7265 ts_tablet_manager.cc:1397] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.004s
I20260928 20:17:26.566664 7265 raft_consensus.cc:348] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.567030 7265 raft_consensus.cc:729] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6630a8999d34a98b97f557a544221fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.567217 7265 consensus_queue.cc:260] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } } peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } }
I20260928 20:17:26.567605 7265 ts_tablet_manager.cc:1428] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:17:26.570261 7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.557869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:57187)
0928 20:17:26.558058 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.558109 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.558915 (+ 806us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.559431 (+ 516us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.559437 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.559866 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:26.560222 (+ 356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.560231 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.561681 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.561682 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.562717 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.562719 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.563556 (+ 837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.563557 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.563708 (+ 151us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.564277 (+ 569us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:26.564288 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:26.565951 (+ 1663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:26.568466 (+ 2515us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.568471 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.568473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.568740 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.569065 (+ 325us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.569066 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.569066 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.569161 (+ 95us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.569660 (+ 499us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:26.569667 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:26.569787 (+ 120us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.569895 (+ 108us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.570025 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":100,"threads_started":1}
I20260928 20:17:26.570463 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.558026 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:57187 (local address 127.24.190.62:42573)
0928 20:17:26.558215 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.558228 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.558258 (+ 30us) server_negotiation.cc:407] Connection header received
0928 20:17:26.559157 (+ 899us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.559164 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.559211 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.559336 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.560379 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.561538 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.562813 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.563442 (+ 629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.563560 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.566099 (+ 2539us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.566103 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.566104 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.566201 (+ 97us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.568386 (+ 2185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.568840 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.568843 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.568844 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.568993 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.569225 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.569226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.569226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.569563 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.569660 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.569978 (+ 318us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.570150 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145,"thread_start_us":76,"threads_started":1}
I20260928 20:17:26.571336 7373 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42573
I20260928 20:17:26.571434 7373 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:26.571635 7373 heartbeater.cc:511] Master 127.24.190.62:42573 requested a full tablet report, sending...
I20260928 20:17:26.572407 7185 ts_manager.cc:194] Registered new tserver with Master: c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375)
I20260928 20:17:26.573750 7185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:57187
I20260928 20:17:26.574740 7373 heartbeater.cc:503] Master 127.24.190.62:42573 was elected leader, sending a full tablet report...
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.1@KRBTEST.COM
I20260928 20:17:26.581858 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.573069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:36375 (local address 127.0.0.1:42222)
0928 20:17:26.573336 (+ 267us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.573361 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.573414 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.573635 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.573640 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.573982 (+ 342us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:26.574054 (+ 72us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.574056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.575208 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.575209 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.576267 (+ 1058us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.576271 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.576875 (+ 604us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.576876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.576959 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.577424 (+ 465us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:26.577429 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:26.578964 (+ 1535us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:26.580794 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.580800 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.580802 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.581014 (+ 212us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.581220 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.581221 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.581221 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.581279 (+ 58us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.581566 (+ 287us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:26.581572 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:26.581613 (+ 41us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.581673 (+ 60us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.581788 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":244,"thread_start_us":107,"threads_started":1}
I20260928 20:17:26.581909 7381 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.573117 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42222 (local address 127.24.190.1:36375)
0928 20:17:26.573511 (+ 394us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.573514 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.573521 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:17:26.573546 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.573547 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.573559 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.573633 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.574141 (+ 508us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.575110 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.576372 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.576806 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.576863 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.579039 (+ 2176us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.579047 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.579047 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.579055 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.580706 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.581087 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.581096 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.581096 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.581158 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.581332 (+ 174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.581333 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.581333 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.581501 (+ 168us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.581573 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.581721 (+ 148us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.581815 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":369,"thread_start_us":68,"threads_started":1}
I20260928 20:17:26.582371 7307 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a06e30766d449cc839a44ae778bcd25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:26 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:42222
I20260928 20:17:26.582978 7382 tablet_replica.cc:330] stopping tablet replica
I20260928 20:17:26.583117 7382 raft_consensus.cc:2229] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:17:26.583199 7382 raft_consensus.cc:2258] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:26.583487 7382 ts_tablet_manager.cc:1905] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:26.585474 7382 ts_tablet_manager.cc:1918] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:26.585562 7382 log.cc:1196] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/8a06e30766d449cc839a44ae778bcd25
I20260928 20:17:26.585819 7382 ts_tablet_manager.cc:1939] T 8a06e30766d449cc839a44ae778bcd25 P c6630a8999d34a98b97f557a544221fd: Deleting consensus metadata
I20260928 20:17:26.586341 7172 catalog_manager.cc:4841] TS c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375): tablet 8a06e30766d449cc839a44ae778bcd25 (table test-table [id=a98ecf7a2f4a43e8a06cf0fff7af4f89]) successfully deleted
W20260928 20:17:26.651010 7378 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:26.651227 7378 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:26.651252 7378 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:26.652426 7378 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:26.652472 7378 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:26.652500 7378 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:17:26.654043 7378 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:38809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=38303
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7378
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:26.654323 7378 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:26.654569 7378 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:26.659787 7387 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:26.659787 7388 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.659931 7378 server_base.cc:1034] running on GCE node
W20260928 20:17:26.659814 7390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.660269 7378 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:26.660481 7378 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:26.661633 7378 hybrid_clock.cc:648] HybridClock initialized: now 1790626646661618 us; error 27 us; skew 500 ppm
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:26.664201 7378 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:17:26.664649 7378 webserver.cc:460] Webserver started at http://127.24.190.2:38303/ using document root <none> and password file <none>
I20260928 20:17:26.664836 7378 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:26.664889 7378 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:26.666245 7378 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:26.666914 7397 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.667073 7378 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:17:26.667156 7378 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "e6bb2d42b3eb43e7a798435b23ec1479"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "cd0bd1174bbd12aa5f5eb8eaec167a60"
server_key_iv: "ddd04042d58ba9bbedb204cf86b41d00"
server_key_version: "encryptionkey@0"
I20260928 20:17:26.667474 7378 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:26.680400 7378 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:26.682706 7378 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:26.682824 7378 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:26.683015 7378 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:26.683334 7378 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:26.683369 7378 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.683391 7378 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:26.683404 7378 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.689512 7378 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:38809
I20260928 20:17:26.689584 7510 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:38809 every 8 connection(s)
I20260928 20:17:26.689929 7378 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:17:26.690546 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7378
I20260928 20:17:26.690855 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:36891
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:42573
--webserver_port=44741
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:26.701799 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.690734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:39823 (local address 127.24.190.62:42573)
0928 20:17:26.690792 (+ 58us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.690794 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.691048 (+ 254us) server_negotiation.cc:407] Connection header received
0928 20:17:26.691590 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.691591 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.691610 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.691683 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.692995 (+ 1312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.693608 (+ 613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.695380 (+ 1772us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.695603 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.695659 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.698548 (+ 2889us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.698550 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.698550 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.698558 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.700209 (+ 1651us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.700717 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.700719 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.700720 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.700784 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.701068 (+ 284us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.701069 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.701070 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.701208 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.701288 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.701584 (+ 296us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.701690 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 20:17:26.702029 7513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.690722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:39823)
0928 20:17:26.690880 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.690937 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.691491 (+ 554us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.691737 (+ 246us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.691741 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.692560 (+ 819us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:26.692855 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.692870 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.693716 (+ 846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.693717 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.695178 (+ 1461us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.695182 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.695705 (+ 523us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.695706 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.695878 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.696685 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:26.696696 (+ 11us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:26.698444 (+ 1748us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:26.700335 (+ 1891us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.700344 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.700347 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.700598 (+ 251us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.700856 (+ 258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.700857 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.700858 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.700985 (+ 127us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.701279 (+ 294us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:26.701287 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:26.701440 (+ 153us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.701560 (+ 120us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.701762 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":86,"threads_started":1}
I20260928 20:17:26.702546 7511 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42573
I20260928 20:17:26.702667 7511 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:26.702858 7511 heartbeater.cc:511] Master 127.24.190.62:42573 requested a full tablet report, sending...
I20260928 20:17:26.703262 7185 ts_manager.cc:194] Registered new tserver with Master: e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
I20260928 20:17:26.703826 7185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:39823
W20260928 20:17:26.775584 7514 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:26.775873 7514 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:26.775900 7514 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:26.777081 7514 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:26.777134 7514 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:26.777160 7514 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:17:26.778640 7514 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:36891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=44741
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7514
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:26.778841 7514 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:26.779021 7514 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:26.784103 7520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:26.784121 7519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:26.784122 7522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:26.784426 7514 server_base.cc:1034] running on GCE node
I20260928 20:17:26.784672 7514 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:26.784917 7514 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:26.786078 7514 hybrid_clock.cc:648] HybridClock initialized: now 1790626646786077 us; error 40 us; skew 500 ppm
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:26.788586 7514 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:17:26.789044 7514 webserver.cc:460] Webserver started at http://127.24.190.3:44741/ using document root <none> and password file <none>
I20260928 20:17:26.789275 7514 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:26.789355 7514 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:26.790709 7514 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:26.791321 7529 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.791479 7514 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.791579 7514 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "810ef3376e6b42a49934fd5e7a638aa7"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "982488b3a0fbcb1b9c905001e20f5501"
server_key_iv: "1cd64d0d3460359cb783e27ef614819b"
server_key_version: "encryptionkey@0"
I20260928 20:17:26.791898 7514 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:26.799912 7514 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:26.802175 7514 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:26.802387 7514 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:26.802608 7514 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:26.802906 7514 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:26.802961 7514 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.803004 7514 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:26.803030 7514 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:26.809055 7514 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36891
I20260928 20:17:26.809115 7642 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36891 every 8 connection(s)
I20260928 20:17:26.809506 7514 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:17:26 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626646, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:26.816267 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7514
I20260928 20:17:26.819512 7376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.810328 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:39259 (local address 127.24.190.62:42573)
0928 20:17:26.810384 (+ 56us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.810386 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.810586 (+ 200us) server_negotiation.cc:407] Connection header received
0928 20:17:26.811082 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.811083 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.811095 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.811226 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.812229 (+ 1003us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.812731 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.813718 (+ 987us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.813914 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.814011 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.816197 (+ 2186us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.816199 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.816200 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.816208 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.817961 (+ 1753us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.818383 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.818384 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.818385 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.818450 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.818765 (+ 315us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.818766 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.818766 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.818888 (+ 122us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.818950 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.819294 (+ 344us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.819410 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":26,"server-negotiator.queue_time_us":22}
I20260928 20:17:26.819546 7645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.810308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:39259)
0928 20:17:26.810463 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.810498 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.810980 (+ 482us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.811315 (+ 335us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.811319 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.811932 (+ 613us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:26.812125 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.812131 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.812810 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.812811 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.813630 (+ 819us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.813632 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.814015 (+ 383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.814015 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.814121 (+ 106us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.814706 (+ 585us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:26.814714 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:26.816095 (+ 1381us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:26.818037 (+ 1942us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.818045 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.818047 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.818314 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.818520 (+ 206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:26.818520 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:26.818521 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:26.818657 (+ 136us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:26.818955 (+ 298us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:26.818961 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:26.819112 (+ 151us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.819230 (+ 118us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.819382 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":91,"threads_started":1}
I20260928 20:17:26.820477 7643 heartbeater.cc:347] Connected to a master server at 127.24.190.62:42573
I20260928 20:17:26.820596 7643 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:26.820823 7643 heartbeater.cc:511] Master 127.24.190.62:42573 requested a full tablet report, sending...
I20260928 20:17:26.821274 7185 ts_manager.cc:194] Registered new tserver with Master: 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891)
I20260928 20:17:26.821638 7185 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:39259
I20260928 20:17:26.824651 7647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.816651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55916 (local address 127.24.190.62:42573)
0928 20:17:26.816771 (+ 120us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.816773 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.816847 (+ 74us) server_negotiation.cc:407] Connection header received
0928 20:17:26.816932 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.816932 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.816941 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.816995 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:26.817755 (+ 760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.818237 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.819276 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.819596 (+ 320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.819671 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.821559 (+ 1888us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:26.821561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:26.821561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:26.821568 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:26.823405 (+ 1837us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.823787 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.823788 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.823789 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.823855 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:26.824086 (+ 231us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:26.824087 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:26.824087 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:26.824213 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:26.824396 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.824439 (+ 43us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.824526 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97,"thread_start_us":62,"threads_started":1}
I20260928 20:17:26.825383 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:17:26.828001 7647 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.825714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55922 (local address 127.24.190.62:42573)
0928 20:17:26.825767 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.825768 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.825905 (+ 137us) server_negotiation.cc:407] Connection header received
0928 20:17:26.825952 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.825952 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.825980 (+ 28us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.826036 (+ 56us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:17:26.826118 (+ 82us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.826611 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.827391 (+ 780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.827570 (+ 179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.827617 (+ 47us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.827755 (+ 138us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:17:26.827845 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:17:26.827906 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.827937 (+ 31us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.827955 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 20:17:26.828269 7185 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:55922:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:17:26.829913 7185 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:17:26.832289 7307 tablet_service.cc:1467] Processing CreateTablet for tablet b96d4103e2ee428593c4e01e2765dd81 (DEFAULT_TABLE table=test-table [id=76e4d488d46c445c8b4505c4b884c4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:26.832523 7307 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b96d4103e2ee428593c4e01e2765dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:26.834036 7265 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Bootstrap starting.
I20260928 20:17:26.834403 7265 tablet_bootstrap.cc:654] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:26.834903 7265 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: No bootstrap required, opened a new log
I20260928 20:17:26.834961 7265 ts_tablet_manager.cc:1397] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260928 20:17:26.835317 7265 raft_consensus.cc:348] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:26.835397 7265 raft_consensus.cc:374] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:26.835443 7265 raft_consensus.cc:729] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6630a8999d34a98b97f557a544221fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.835489 7265 consensus_queue.cc:260] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:26.835572 7265 ts_tablet_manager.cc:1428] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s
I20260928 20:17:26.836309 7380 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.831720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36891 (local address 127.0.0.1:34184)
0928 20:17:26.831770 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.831782 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.831836 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.832269 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.832271 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.832272 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.832320 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.832322 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.833594 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.833595 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.835014 (+ 1419us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.835018 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.836043 (+ 1025us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.836044 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.836118 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.836134 (+ 16us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.836193 (+ 59us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.836239 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":52}
I20260928 20:17:26.836325 7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.831834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34184 (local address 127.24.190.3:36891)
0928 20:17:26.832083 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.832087 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.832094 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:17:26.832149 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.832151 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.832167 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.832245 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.832399 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.833449 (+ 1050us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.835094 (+ 1645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.835939 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.836042 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.836100 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.836208 (+ 108us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.836245 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":224,"thread_start_us":94,"threads_started":1}
I20260928 20:17:26.836555 7650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.831818 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:38809 (local address 127.0.0.1:37288)
0928 20:17:26.831968 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:26.831974 (+ 6us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:26.832001 (+ 27us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:26.832500 (+ 499us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:26.832500 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:26.832502 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:26.832537 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.832538 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.833572 (+ 1034us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.833573 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.835097 (+ 1524us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:26.835099 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.836257 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.836258 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:26.836326 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.836330 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:26.836438 (+ 108us) client_negotiation.cc:240] Negotiation successful
0928 20:17:26.836486 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":139,"mutex_wait_us":42,"thread_start_us":116,"threads_started":1}
I20260928 20:17:26.836730 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:26.832139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37288 (local address 127.24.190.2:38809)
0928 20:17:26.832346 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:26.832351 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:26.832361 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:26.832402 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:26.832404 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:26.832420 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:26.832499 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:26.832595 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.833463 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.835196 (+ 1733us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:26.836078 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:26.836156 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:26.836221 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:26.836640 (+ 419us) server_negotiation.cc:299] Negotiation successful
0928 20:17:26.836673 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":175,"thread_start_us":100,"threads_started":1}
I20260928 20:17:26.837013 7577 tablet_service.cc:1467] Processing CreateTablet for tablet b96d4103e2ee428593c4e01e2765dd81 (DEFAULT_TABLE table=test-table [id=76e4d488d46c445c8b4505c4b884c4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:26.837329 7577 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b96d4103e2ee428593c4e01e2765dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:26.838941 7445 tablet_service.cc:1467] Processing CreateTablet for tablet b96d4103e2ee428593c4e01e2765dd81 (DEFAULT_TABLE table=test-table [id=76e4d488d46c445c8b4505c4b884c4c7]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:26.839277 7445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b96d4103e2ee428593c4e01e2765dd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:26.840389 7653 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Bootstrap starting.
I20260928 20:17:26.841115 7653 tablet_bootstrap.cc:654] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:26.841734 7653 log.cc:824] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.842705 7653 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: No bootstrap required, opened a new log
I20260928 20:17:26.842787 7653 ts_tablet_manager.cc:1397] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:17:26.843278 7655 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Bootstrap starting.
I20260928 20:17:26.843842 7655 tablet_bootstrap.cc:654] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:26.844293 7655 log.cc:824] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:26.844707 7653 raft_consensus.cc:348] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:26.844888 7653 raft_consensus.cc:374] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:26.844934 7653 raft_consensus.cc:729] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 810ef3376e6b42a49934fd5e7a638aa7, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.845120 7655 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: No bootstrap required, opened a new log
I20260928 20:17:26.845074 7653 consensus_queue.cc:260] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:26.845194 7655 ts_tablet_manager.cc:1397] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:17:26.845403 7643 heartbeater.cc:503] Master 127.24.190.62:42573 was elected leader, sending a full tablet report...
I20260928 20:17:26.845402 7653 ts_tablet_manager.cc:1428] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:17:26.847079 7655 raft_consensus.cc:348] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:26.847229 7655 raft_consensus.cc:374] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:26.847273 7655 raft_consensus.cc:729] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6bb2d42b3eb43e7a798435b23ec1479, State: Initialized, Role: FOLLOWER
I20260928 20:17:26.847381 7655 consensus_queue.cc:260] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:26.847627 7655 ts_tablet_manager.cc:1428] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s
I20260928 20:17:26.847730 7511 heartbeater.cc:503] Master 127.24.190.62:42573 was elected leader, sending a full tablet report...
W20260928 20:17:26.940529 7512 tablet.cc:2369] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:17:27.057932 7374 tablet.cc:2369] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:17:27.060050 7644 tablet.cc:2369] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:17:27.065212 7379 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:27.065351 7379 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:27.065719 7379 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
I20260928 20:17:27.068698 7649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.066061 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:36991 (local address 127.24.190.3:36891)
0928 20:17:27.066113 (+ 52us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:27.066116 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:27.066137 (+ 21us) server_negotiation.cc:407] Connection header received
0928 20:17:27.066169 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:27.066170 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:27.066181 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:27.066249 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:27.066460 (+ 211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.066940 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.067950 (+ 1010us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.068331 (+ 381us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.068415 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:27.068424 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:27.068591 (+ 167us) server_negotiation.cc:299] Negotiation successful
0928 20:17:27.068630 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28}
I20260928 20:17:27.068691 7375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.065939 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36891 (local address 127.24.190.1:36991)
0928 20:17:27.065997 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.066010 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:27.066068 (+ 58us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:27.066289 (+ 221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:27.066290 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:27.066292 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:27.066379 (+ 87us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:27.066380 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.067027 (+ 647us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.067028 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:27.067828 (+ 800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:27.067831 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.068412 (+ 581us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.068413 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:27.068491 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:27.068510 (+ 19us) client_negotiation.cc:769] Sending connection context
0928 20:17:27.068573 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:17:27.068616 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34,"mutex_wait_us":11}
I20260928 20:17:27.068799 7651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.066172 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:50637 (local address 127.24.190.2:38809)
0928 20:17:27.066232 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:27.066235 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:27.066245 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:27.066333 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:27.066335 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:27.066343 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:27.066413 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:27.066568 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.067041 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.068037 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.068429 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.068512 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:27.068522 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:27.068669 (+ 147us) server_negotiation.cc:299] Negotiation successful
0928 20:17:27.068714 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":31}
I20260928 20:17:27.069001 7659 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.066083 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:38809 (local address 127.24.190.1:50637)
0928 20:17:27.066181 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.066199 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:27.066242 (+ 43us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:27.066417 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:27.066418 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:27.066419 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:27.066499 (+ 80us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:27.066501 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.067123 (+ 622us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.067124 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:27.067944 (+ 820us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:27.067947 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.068527 (+ 580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.068528 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:27.068599 (+ 71us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:27.068602 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:17:27.068665 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:17:27.068703 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87,"thread_start_us":68,"threads_started":1}
I20260928 20:17:27.069234 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96d4103e2ee428593c4e01e2765dd81" candidate_uuid: "c6630a8999d34a98b97f557a544221fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810ef3376e6b42a49934fd5e7a638aa7" is_pre_election: true
I20260928 20:17:27.069329 7465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96d4103e2ee428593c4e01e2765dd81" candidate_uuid: "c6630a8999d34a98b97f557a544221fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" is_pre_election: true
I20260928 20:17:27.069432 7597 raft_consensus.cc:2454] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6630a8999d34a98b97f557a544221fd in term 0.
I20260928 20:17:27.069514 7465 raft_consensus.cc:2454] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6630a8999d34a98b97f557a544221fd in term 0.
I20260928 20:17:27.069726 7262 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810ef3376e6b42a49934fd5e7a638aa7, c6630a8999d34a98b97f557a544221fd; no voters:
I20260928 20:17:27.069885 7379 raft_consensus.cc:2781] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:17:27.069964 7379 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:17:27.069988 7379 raft_consensus.cc:3037] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:27.070794 7379 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:27.070948 7379 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 1 election: Requested vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
I20260928 20:17:27.071148 7465 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96d4103e2ee428593c4e01e2765dd81" candidate_uuid: "c6630a8999d34a98b97f557a544221fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6bb2d42b3eb43e7a798435b23ec1479"
I20260928 20:17:27.071130 7597 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b96d4103e2ee428593c4e01e2765dd81" candidate_uuid: "c6630a8999d34a98b97f557a544221fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "810ef3376e6b42a49934fd5e7a638aa7"
I20260928 20:17:27.071218 7597 raft_consensus.cc:3037] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:27.071218 7465 raft_consensus.cc:3037] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:27.072144 7597 raft_consensus.cc:2454] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6630a8999d34a98b97f557a544221fd in term 1.
I20260928 20:17:27.072234 7465 raft_consensus.cc:2454] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6630a8999d34a98b97f557a544221fd in term 1.
I20260928 20:17:27.072377 7262 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 810ef3376e6b42a49934fd5e7a638aa7, c6630a8999d34a98b97f557a544221fd; no voters:
I20260928 20:17:27.072476 7379 raft_consensus.cc:2781] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:27.072631 7379 raft_consensus.cc:686] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 LEADER]: Becoming Leader. State: Replica: c6630a8999d34a98b97f557a544221fd, State: Running, Role: LEADER
I20260928 20:17:27.072708 7379 consensus_queue.cc:237] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:27.073518 7185 catalog_manager.cc:5495] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd reported cstate change: term changed from 0 to 1, leader changed from <none> to c6630a8999d34a98b97f557a544221fd (127.24.190.1). New cstate: current_term: 1 leader_uuid: "c6630a8999d34a98b97f557a544221fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } health_report { overall_health: HEALTHY } } }
I20260928 20:17:27.120712 7663 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.118257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42228 (local address 127.24.190.1:36375)
0928 20:17:27.118393 (+ 136us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:27.118395 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:27.118404 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:17:27.118451 (+ 47us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:27.118452 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:27.118470 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:27.118554 (+ 84us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:17:27.118684 (+ 130us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.119179 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.119897 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:27.120111 (+ 214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:27.120184 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:27.120342 (+ 158us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:17:27.120449 (+ 107us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:17:27.120532 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:27.120572 (+ 40us) server_negotiation.cc:299] Negotiation successful
0928 20:17:27.120593 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112,"thread_start_us":80,"threads_started":1}
I20260928 20:17:27.122153 7465 raft_consensus.cc:1261] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Refusing update from remote peer c6630a8999d34a98b97f557a544221fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:27.122156 7597 raft_consensus.cc:1261] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Refusing update from remote peer c6630a8999d34a98b97f557a544221fd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:27.122552 7379 consensus_queue.cc:1035] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:27.122686 7660 consensus_queue.cc:1035] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:27.124970 7664 mvcc.cc:205] Tried to move back new op lower bound from 7334406746609917952 to 7334406746410598400. Current Snapshot: MvccSnapshot[applied={T|T < 7334406746609917952}]
I20260928 20:17:27.125108 7665 mvcc.cc:205] Tried to move back new op lower bound from 7334406746609917952 to 7334406746410598400. Current Snapshot: MvccSnapshot[applied={T|T < 7334406746609917952}]
I20260928 20:17:27.125355 7666 mvcc.cc:205] Tried to move back new op lower bound from 7334406746609917952 to 7334406746410598400. Current Snapshot: MvccSnapshot[applied={T|T < 7334406746609917952 or (T in {7334406746609917952})}]
I20260928 20:17:27.127040 7184 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:55922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:27.127136 7184 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:55922:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:27.127866 7184 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Sending DeleteTablet for 3 replicas of tablet b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:27.128182 7577 tablet_service.cc:1514] Processing DeleteTablet for tablet b96d4103e2ee428593c4e01e2765dd81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:27 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:34184
I20260928 20:17:27.128206 7445 tablet_service.cc:1514] Processing DeleteTablet for tablet b96d4103e2ee428593c4e01e2765dd81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:27 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:37288
I20260928 20:17:27.128286 7307 tablet_service.cc:1514] Processing DeleteTablet for tablet b96d4103e2ee428593c4e01e2765dd81 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:27 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:42222
I20260928 20:17:27.128418 7675 tablet_replica.cc:330] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: stopping tablet replica
I20260928 20:17:27.128516 7675 raft_consensus.cc:2229] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:17:27.128532 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 7223
I20260928 20:17:27.128624 7675 raft_consensus.cc:2258] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:27.129136 7674 tablet_replica.cc:330] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: stopping tablet replica
I20260928 20:17:27.129259 7674 raft_consensus.cc:2229] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:17:27.129384 7674 raft_consensus.cc:2258] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:27.129472 7675 ts_tablet_manager.cc:1905] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:27.129837 7674 ts_tablet_manager.cc:1905] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:27.131170 7675 ts_tablet_manager.cc:1918] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:27.131245 7675 log.cc:1196] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:27.131531 7675 ts_tablet_manager.cc:1939] T b96d4103e2ee428593c4e01e2765dd81 P e6bb2d42b3eb43e7a798435b23ec1479: Deleting consensus metadata
I20260928 20:17:27.131829 7674 ts_tablet_manager.cc:1918] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:27.131911 7674 log.cc:1196] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:27.132061 7172 catalog_manager.cc:4841] TS e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): tablet b96d4103e2ee428593c4e01e2765dd81 (table test-table [id=76e4d488d46c445c8b4505c4b884c4c7]) successfully deleted
I20260928 20:17:27.132194 7674 ts_tablet_manager.cc:1939] T b96d4103e2ee428593c4e01e2765dd81 P 810ef3376e6b42a49934fd5e7a638aa7: Deleting consensus metadata
I20260928 20:17:27.132616 7172 catalog_manager.cc:4841] TS 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): tablet b96d4103e2ee428593c4e01e2765dd81 (table test-table [id=76e4d488d46c445c8b4505c4b884c4c7]) successfully deleted
W20260928 20:17:27.134490 7172 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:36375 (error 108)
I20260928 20:17:27.135051 7650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.134869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:36375 (local address 127.0.0.1:42236)
0928 20:17:27.134957 (+ 88us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.135011 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:36375: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260928 20:17:27.135066 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 7378
W20260928 20:17:27.135712 7172 catalog_manager.cc:4584] TS c6630a8999d34a98b97f557a544221fd (127.24.190.1:36375): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b96d4103e2ee428593c4e01e2765dd81: Network error: Client connection negotiation failed: client connection to 127.24.190.1:36375: connect: Connection refused (error 111)
I20260928 20:17:27.140826 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 7514
I20260928 20:17:27.145660 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 7152
I20260928 20:17:27.151185 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42573
--webserver_interface=127.24.190.62
--webserver_port=41231
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:42573
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:27.232896 7678 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:27.233145 7678 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:27.233184 7678 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:27.234392 7678 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:27.234460 7678 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:27.234484 7678 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:27.234505 7678 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:27.234532 7678 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:27.236049 7678 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:42573
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:42573
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=41231
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7678
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:27.236332 7678 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:27.236557 7678 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:27.241560 7683 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.241556 7686 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.241556 7684 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:27.241837 7678 server_base.cc:1034] running on GCE node
I20260928 20:17:27.242206 7678 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:27.242540 7678 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:27.243731 7678 hybrid_clock.cc:648] HybridClock initialized: now 1790626647243710 us; error 46 us; skew 500 ppm
Sep 28 20:17:27 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626647, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:27.246372 7678 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:27.246816 7678 webserver.cc:460] Webserver started at http://127.24.190.62:41231/ using document root <none> and password file <none>
I20260928 20:17:27.247017 7678 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:27.247061 7678 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:27.248373 7678 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:27.248978 7693 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.249183 7678 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:27.249256 7678 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "57f1e08def4d49a9b3a93a4abd20f3fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "637f96cee49b11acecdf38fa5adb059b"
server_key_iv: "f406ddc4653ef1a3003a39546cd48bd1"
server_key_version: "encryptionkey@0"
I20260928 20:17:27.249593 7678 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:27.264036 7678 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:27.266440 7678 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:27.266558 7678 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:27.270565 7678 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:42573
I20260928 20:17:27.270637 7745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:42573 every 8 connection(s)
I20260928 20:17:27.270998 7678 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:27.272634 7746 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:17:27.273290 7746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap starting.
I20260928 20:17:27.275897 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7678
I20260928 20:17:27.276162 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:36375
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:42573
--webserver_port=38209
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:17:27.281998 7746 log.cc:824] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:27.284250 7746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:17:27.284554 7746 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd: Bootstrap complete.
I20260928 20:17:27.286854 7746 raft_consensus.cc:348] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:27.287096 7746 raft_consensus.cc:729] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 57f1e08def4d49a9b3a93a4abd20f3fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:27.287281 7746 consensus_queue.cc:260] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:27.287357 7746 raft_consensus.cc:388] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:27.287410 7746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:27.287457 7746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:17:27.288450 7746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:27.288568 7746 leader_election.cc:302] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 57f1e08def4d49a9b3a93a4abd20f3fd; no voters:
I20260928 20:17:27.288766 7746 leader_election.cc:288] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [CANDIDATE]: Term 3 election: Requested vote from peers
I20260928 20:17:27.288803 7750 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 3 FOLLOWER]: Leader election won for term 3
I20260928 20:17:27.288908 7750 raft_consensus.cc:686] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [term 3 LEADER]: Becoming Leader. State: Replica: 57f1e08def4d49a9b3a93a4abd20f3fd, State: Running, Role: LEADER
I20260928 20:17:27.288993 7750 consensus_queue.cc:237] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } }
I20260928 20:17:27.289044 7746 sys_catalog.cc:564] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:27.289275 7751 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } } }
I20260928 20:17:27.289366 7751 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:27.289270 7750 sys_catalog.cc:455] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 57f1e08def4d49a9b3a93a4abd20f3fd. Latest consensus state: current_term: 3 leader_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "57f1e08def4d49a9b3a93a4abd20f3fd" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 42573 } } }
I20260928 20:17:27.289559 7750 sys_catalog.cc:458] T 00000000000000000000000000000000 P 57f1e08def4d49a9b3a93a4abd20f3fd [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:27.289685 7754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:27.290582 7754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:27.290700 7754 catalog_manager.cc:1259] Loaded cluster ID: f4ca78cb737a4d0b9161459e2b841e7c
I20260928 20:17:27.290738 7754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260928 20:17:27.290953 7754 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa6e53579ad google::LogMessage::Fail() at ??:0
@ 0x7fa6e535a88a google::LogMessage::SendToLog() at ??:0
@ 0x7fa6e53574de google::LogMessage::Flush() at ??:0
@ 0x7fa6e5358a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa6ed27c0f1 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fa6ed2858b9 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa6e72250d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa6e721a954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa6e807e6db start_thread at ??:0
@ 0x7fa6e3e5561f clone at ??:0
W20260928 20:17:27.369995 7748 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:27.370223 7748 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:27.370261 7748 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:27.371495 7748 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:27.371559 7748 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:27.371601 7748 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:17:27.373049 7748 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:36375
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=38209
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7748
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:27.373322 7748 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:27.373548 7748 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:27.378588 7785 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.378641 7782 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.378611 7783 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:27.378926 7748 server_base.cc:1034] running on GCE node
I20260928 20:17:27.379148 7748 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:27.379417 7748 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:27.380570 7748 hybrid_clock.cc:648] HybridClock initialized: now 1790626647380560 us; error 28 us; skew 500 ppm
Sep 28 20:17:27 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626647, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:27.383052 7748 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:17:27.383553 7748 webserver.cc:460] Webserver started at http://127.24.190.1:38209/ using document root <none> and password file <none>
I20260928 20:17:27.383805 7748 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:27.383852 7748 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:27.385120 7748 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:27.385777 7792 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.385962 7748 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:27.386025 7748 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c6630a8999d34a98b97f557a544221fd"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "54db0a9c2cc43482552dc1318dbbaf97"
server_key_iv: "a3b7fe89e6dc4674ec89fb9483265d01"
server_key_version: "encryptionkey@0"
I20260928 20:17:27.386426 7748 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:27.407730 7748 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:27.410169 7748 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:27.410358 7748 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:27.410645 7748 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:27.411121 7799 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 20:17:27.413072 7748 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 20:17:27.413133 7748 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260928 20:17:27.413177 7748 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 20:17:27.413864 7748 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 20:17:27.413918 7748 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260928 20:17:27.413986 7799 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Bootstrap starting.
I20260928 20:17:27.421223 7748 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:36375
I20260928 20:17:27.421625 7748 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:17:27.422199 7906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:36375 every 8 connection(s)
I20260928 20:17:27.424860 7799 log.cc:824] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:27.427520 7799 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:17:27.427826 7799 tablet_bootstrap.cc:492] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Bootstrap complete.
I20260928 20:17:27.429035 7799 ts_tablet_manager.cc:1397] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260928 20:17:27.430510 7799 raft_consensus.cc:348] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:27.430838 7799 raft_consensus.cc:729] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6630a8999d34a98b97f557a544221fd, State: Initialized, Role: FOLLOWER
I20260928 20:17:27.430989 7799 consensus_queue.cc:260] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:27.431283 7799 ts_tablet_manager.cc:1428] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s
I20260928 20:17:27.431478 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7748
I20260928 20:17:27.431725 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:38809
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:42573
--webserver_port=38303
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:27.488780 7909 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:17:27.422412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:56069)
0928 20:17:27.422586 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.422630 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:27.423095 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:27.488539 (+ 65444us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":132,"thread_start_us":103,"threads_started":1}
W20260928 20:17:27.489037 7907 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:42573 (0 consecutive failures): Network error: Failed to ping master at 127.24.190.62:42573: Client connection negotiation failed: client connection to 127.24.190.62:42573: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 20:17:27.489424 7909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.489273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:47547)
0928 20:17:27.489335 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.489394 (+ 59us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":38}
I20260928 20:17:27.489768 7909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.489681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:47517)
0928 20:17:27.489725 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.489751 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 20:17:27.489919 7907 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 20:17:27.525139 7912 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:27.525420 7912 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:27.525447 7912 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:27.526650 7912 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:27.526690 7912 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:27.526716 7912 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:17:27.528118 7912 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:38809
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=38303
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.7912
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:27.528322 7912 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:27.528497 7912 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:27.533492 7918 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.533535 7917 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.533535 7920 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:27.533557 7912 server_base.cc:1034] running on GCE node
I20260928 20:17:27.533866 7912 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:27.534098 7912 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:27.535255 7912 hybrid_clock.cc:648] HybridClock initialized: now 1790626647535226 us; error 39 us; skew 500 ppm
Sep 28 20:17:27 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626647, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:27.537722 7912 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:17:27.538158 7912 webserver.cc:460] Webserver started at http://127.24.190.2:38303/ using document root <none> and password file <none>
I20260928 20:17:27.538393 7912 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:27.538439 7912 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:27.539753 7912 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:27.540335 7927 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.540485 7912 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:27.540567 7912 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "e6bb2d42b3eb43e7a798435b23ec1479"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "cd0bd1174bbd12aa5f5eb8eaec167a60"
server_key_iv: "ddd04042d58ba9bbedb204cf86b41d00"
server_key_version: "encryptionkey@0"
I20260928 20:17:27.540887 7912 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:27.564230 7912 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:27.566115 7912 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:27.566236 7912 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:27.566491 7912 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:27.566807 7912 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:27.566845 7912 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.566867 7912 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:27.566880 7912 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.572636 7912 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:38809
I20260928 20:17:27.572732 8040 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:38809 every 8 connection(s)
I20260928 20:17:27.573038 7912 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:17:27.574090 8043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.573712 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:51133)
0928 20:17:27.573870 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.573944 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":90,"threads_started":1}
W20260928 20:17:27.574541 8041 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:42573 (0 consecutive failures): Network error: Failed to ping master at 127.24.190.62:42573: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
I20260928 20:17:27.574806 8043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.574715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:53707)
0928 20:17:27.574759 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.574783 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":27}
I20260928 20:17:27.575085 8043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.575005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:46017)
0928 20:17:27.575044 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.575066 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
W20260928 20:17:27.575186 8041 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 20:17:27.577369 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 7912
I20260928 20:17:27.577584 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:36891
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:42573
--webserver_port=44741
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:33263
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:27.659600 8044 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:27.659852 8044 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:27.659893 8044 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:27.661130 8044 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:27.661199 8044 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:27.661243 8044 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:17:27.662801 8044 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:33263
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:36891
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=44741
--tserver_master_addrs=127.24.190.62:42573
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:27.663069 8044 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:27.663300 8044 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:27.668450 8049 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.668460 8050 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:27.668541 8052 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:27.668588 8044 server_base.cc:1034] running on GCE node
I20260928 20:17:27.668879 8044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:27.669070 8044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:27.670207 8044 hybrid_clock.cc:648] HybridClock initialized: now 1790626647670194 us; error 25 us; skew 500 ppm
Sep 28 20:17:27 dist-test-slave-n45k krb5kdc[6606](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626647, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:27.672608 8044 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:17:27.673022 8044 webserver.cc:460] Webserver started at http://127.24.190.3:44741/ using document root <none> and password file <none>
I20260928 20:17:27.673238 8044 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:27.673322 8044 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:27.674765 8044 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:17:27.675395 8059 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.675560 8044 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:17:27.675654 8044 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "810ef3376e6b42a49934fd5e7a638aa7"
format_stamp: "Formatted at 2026-09-28 20:17:25 on dist-test-slave-n45k"
server_key: "982488b3a0fbcb1b9c905001e20f5501"
server_key_iv: "1cd64d0d3460359cb783e27ef614819b"
server_key_version: "encryptionkey@0"
I20260928 20:17:27.676009 8044 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:27.687271 8044 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:27.689105 8044 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:27.689307 8044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:27.689561 8044 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:27.689878 8044 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:27.689911 8044 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.689934 8044 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:27.689946 8044 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:27.695598 8044 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:36891
I20260928 20:17:27.695662 8172 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:36891 every 8 connection(s)
I20260928 20:17:27.695981 8044 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:17:27.697000 8175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.696643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:52079)
0928 20:17:27.696796 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.696869 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":113,"thread_start_us":74,"threads_started":1}
W20260928 20:17:27.697396 8173 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:42573 (0 consecutive failures): Network error: Failed to ping master at 127.24.190.62:42573: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
I20260928 20:17:27.697660 8175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.697579 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:38807)
0928 20:17:27.697618 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.697644 (+ 26us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":25}
I20260928 20:17:27.697908 8175 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:27.697842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:36885)
0928 20:17:27.697875 (+ 33us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:27.697895 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":22}
W20260928 20:17:27.698027 8173 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 20:17:27.702224 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8044
I20260928 20:17:28.490698 8177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.490256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:38905)
0928 20:17:28.490603 (+ 347us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:28.490644 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":329,"thread_start_us":222,"threads_started":1}
I20260928 20:17:28.575793 8178 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.575528 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:54065)
0928 20:17:28.575673 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:28.575726 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
I20260928 20:17:28.575938 8179 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:28.576090 8179 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:28.576411 8179 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
Sep 28 20:17:28 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626647, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.3@KRBTEST.COM
Sep 28 20:17:28 dist-test-slave-n45k krb5kdc[6606](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626647, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.2@KRBTEST.COM
I20260928 20:17:28.591061 8181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.576740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:41639 (local address 127.24.190.3:36891)
0928 20:17:28.576983 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:28.576991 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:28.577010 (+ 19us) server_negotiation.cc:407] Connection header received
0928 20:17:28.577638 (+ 628us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:28.577642 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:28.577707 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:28.577970 (+ 263us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:28.578869 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.580504 (+ 1635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.582234 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.582908 (+ 674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.583044 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:28.586091 (+ 3047us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:28.586097 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:28.586097 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:28.586116 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:28.588564 (+ 2448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:28.589318 (+ 754us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:28.589321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:28.589322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:28.589460 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:28.589873 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:28.589875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:28.589875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:28.590260 (+ 385us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:28.590372 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:28.590779 (+ 407us) server_negotiation.cc:299] Negotiation successful
0928 20:17:28.590934 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":205,"thread_start_us":53,"threads_started":1}
I20260928 20:17:28.591061 8182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.576740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:53431 (local address 127.24.190.2:38809)
0928 20:17:28.576907 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:28.576919 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:28.576954 (+ 35us) server_negotiation.cc:407] Connection header received
0928 20:17:28.577530 (+ 576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:28.577534 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:28.577592 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:28.577768 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:28.578873 (+ 1105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.580460 (+ 1587us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.582143 (+ 1683us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.582920 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.583052 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:28.586439 (+ 3387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:28.586443 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:28.586443 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:28.586455 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:28.588606 (+ 2151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:28.589318 (+ 712us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:28.589321 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:28.589322 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:28.589460 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:28.589873 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:28.589875 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:28.589875 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:28.590239 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:28.590373 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:28.590779 (+ 406us) server_negotiation.cc:299] Negotiation successful
0928 20:17:28.590933 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":132,"thread_start_us":56,"threads_started":1}
I20260928 20:17:28.591063 8177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.576561 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:36891 (local address 127.24.190.1:41639)
0928 20:17:28.576620 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:28.576634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:28.576843 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:28.577879 (+ 1036us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:28.577883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:28.578438 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:28.578732 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:28.578740 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.580600 (+ 1860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.580601 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:28.582025 (+ 1424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:28.582029 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.583032 (+ 1003us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.583032 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:28.583203 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:28.583934 (+ 731us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:28.583938 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:28.585965 (+ 2027us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:28.588706 (+ 2741us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:28.588710 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:28.588710 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:28.589185 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:28.589547 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:28.589548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:28.589548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:28.589772 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:28.590347 (+ 575us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:28.590354 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:28.590565 (+ 211us) client_negotiation.cc:769] Sending connection context
0928 20:17:28.590727 (+ 162us) client_negotiation.cc:240] Negotiation successful
0928 20:17:28.590934 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37,"mutex_wait_us":123}
I20260928 20:17:28.591125 8180 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.576686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:38809 (local address 127.24.190.1:53431)
0928 20:17:28.576834 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:28.576843 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:28.576888 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:28.577879 (+ 991us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:28.577883 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:28.578438 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:28.578732 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:28.578740 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.580590 (+ 1850us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.580591 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:28.582025 (+ 1434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:28.582029 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:28.583029 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:28.583030 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:28.583201 (+ 171us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:28.583912 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:28.583924 (+ 12us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:28.586339 (+ 2415us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:28.588700 (+ 2361us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:28.588708 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:28.588710 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:28.589185 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:28.589547 (+ 362us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:28.589548 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:28.589548 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:28.589772 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:28.590356 (+ 584us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:28.590356 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:28.590565 (+ 209us) client_negotiation.cc:769] Sending connection context
0928 20:17:28.590702 (+ 137us) client_negotiation.cc:240] Negotiation successful
0928 20:17:28.590993 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":136,"mutex_wait_us":180,"thread_start_us":71,"threads_started":1}
W20260928 20:17:28.592401 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
W20260928 20:17:28.592507 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:28.592531 7796 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6630a8999d34a98b97f557a544221fd; no voters: 810ef3376e6b42a49934fd5e7a638aa7, e6bb2d42b3eb43e7a798435b23ec1479
I20260928 20:17:28.592639 8179 raft_consensus.cc:2726] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:17:28.698598 8183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:28.698404 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:43529)
0928 20:17:28.698513 (+ 109us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:28.698555 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92,"thread_start_us":50,"threads_started":1}
I20260928 20:17:29.491410 8184 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:29.491198 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:56327)
0928 20:17:29.491324 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:29.491365 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":67,"threads_started":1}
I20260928 20:17:29.576572 8185 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:29.576336 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:60171)
0928 20:17:29.576469 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:29.576526 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":68,"threads_started":1}
I20260928 20:17:29.699311 8186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:29.699065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:43783)
0928 20:17:29.699210 (+ 145us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:29.699252 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":69,"threads_started":1}
I20260928 20:17:30.492187 8187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:30.491913 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:33635)
0928 20:17:30.492085 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:30.492140 (+ 55us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":153,"thread_start_us":98,"threads_started":1}
I20260928 20:17:30.577327 8188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:30.577069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:45307)
0928 20:17:30.577250 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:30.577286 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":164,"thread_start_us":87,"threads_started":1}
I20260928 20:17:30.699993 8189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:30.699767 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:47347)
0928 20:17:30.699909 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:30.699951 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":62,"threads_started":1}
I20260928 20:17:30.757166 8190 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:30.757264 8190 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:30.757388 8190 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
W20260928 20:17:30.757807 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
W20260928 20:17:30.757961 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:30.758014 7796 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6630a8999d34a98b97f557a544221fd; no voters: 810ef3376e6b42a49934fd5e7a638aa7, e6bb2d42b3eb43e7a798435b23ec1479
I20260928 20:17:30.758172 8190 raft_consensus.cc:2726] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:17:31.492892 8191 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:31.492651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:42111)
0928 20:17:31.492793 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:31.492835 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":81,"threads_started":1}
I20260928 20:17:31.578083 8192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:31.577844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:53959)
0928 20:17:31.577986 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:31.578028 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":91,"threads_started":1}
I20260928 20:17:31.700644 8193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:31.700440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:33729)
0928 20:17:31.700567 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:31.700601 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":61,"threads_started":1}
I20260928 20:17:32.493570 8194 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:32.493358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:48105)
0928 20:17:32.493487 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:32.493524 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":112,"thread_start_us":62,"threads_started":1}
I20260928 20:17:32.578855 8195 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:32.578615 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:44205)
0928 20:17:32.578769 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:32.578808 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":136,"thread_start_us":63,"threads_started":1}
I20260928 20:17:32.701310 8196 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:32.701118 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:43789)
0928 20:17:32.701230 (+ 112us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:32.701265 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95,"thread_start_us":57,"threads_started":1}
I20260928 20:17:33.138605 8197 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:33.138765 8197 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:33.138973 8197 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
W20260928 20:17:33.139397 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
W20260928 20:17:33.139467 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:33.139482 7796 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6630a8999d34a98b97f557a544221fd; no voters: 810ef3376e6b42a49934fd5e7a638aa7, e6bb2d42b3eb43e7a798435b23ec1479
I20260928 20:17:33.139580 8197 raft_consensus.cc:2726] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:17:33.494383 8198 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:33.494032 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:58333)
0928 20:17:33.494240 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:33.494335 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190,"thread_start_us":63,"threads_started":1}
I20260928 20:17:33.579581 8199 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:33.579323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:42461)
0928 20:17:33.579499 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:33.579542 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":105,"threads_started":1}
I20260928 20:17:33.702018 8200 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:33.701773 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:59433)
0928 20:17:33.701921 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:33.701974 (+ 53us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":75,"threads_started":1}
I20260928 20:17:34.495059 8201 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:34.494850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:39365)
0928 20:17:34.494977 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:34.495013 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":70,"threads_started":1}
I20260928 20:17:34.580297 8202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:34.580078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:58259)
0928 20:17:34.580207 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:34.580250 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":59,"threads_started":1}
I20260928 20:17:34.702661 8203 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:34.702466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:42077)
0928 20:17:34.702585 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:34.702620 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":61,"threads_started":1}
I20260928 20:17:35.495774 8204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:35.495566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:43823)
0928 20:17:35.495692 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:35.495729 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":73,"threads_started":1}
I20260928 20:17:35.573917 8205 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:35.574028 8205 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:35.574199 8205 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
W20260928 20:17:35.574646 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
W20260928 20:17:35.574708 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:35.574726 7796 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6630a8999d34a98b97f557a544221fd; no voters: 810ef3376e6b42a49934fd5e7a638aa7, e6bb2d42b3eb43e7a798435b23ec1479
I20260928 20:17:35.574801 8205 raft_consensus.cc:2726] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:17:35.581003 8206 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:35.580770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:40587)
0928 20:17:35.580930 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:35.580965 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":145,"thread_start_us":94,"threads_started":1}
I20260928 20:17:35.703601 8207 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:35.703189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:56641)
0928 20:17:35.703525 (+ 336us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:35.703559 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":322,"thread_start_us":288,"threads_started":1}
I20260928 20:17:36.496429 8208 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:36.496218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:51235)
0928 20:17:36.496349 (+ 131us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:36.496384 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":65,"threads_started":1}
I20260928 20:17:36.581633 8209 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:36.581429 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:52347)
0928 20:17:36.581548 (+ 119us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:36.581586 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":104,"thread_start_us":62,"threads_started":1}
I20260928 20:17:36.704375 8210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:36.704065 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:36259)
0928 20:17:36.704265 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:36.704308 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":178,"thread_start_us":94,"threads_started":1}
I20260928 20:17:37.497206 8211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:37.496961 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:36333)
0928 20:17:37.497121 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:37.497158 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":140,"thread_start_us":79,"threads_started":1}
I20260928 20:17:37.582332 8212 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:37.582079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:58195)
0928 20:17:37.582218 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:37.582256 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":59,"threads_started":1}
I20260928 20:17:37.705057 8213 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:37.704852 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:51633)
0928 20:17:37.704975 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:37.705014 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":62,"threads_started":1}
I20260928 20:17:38.498020 8214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:38.497753 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:35049)
0928 20:17:38.497930 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:38.497974 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156,"thread_start_us":97,"threads_started":1}
I20260928 20:17:38.583084 8215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:38.582845 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:56927)
0928 20:17:38.582987 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:38.583032 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":72,"threads_started":1}
I20260928 20:17:38.705796 8216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:38.705566 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:36841)
0928 20:17:38.705716 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:38.705752 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":83,"threads_started":1}
I20260928 20:17:39.498836 8217 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:39.498590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:44663)
0928 20:17:39.498738 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:39.498782 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":69,"threads_started":1}
I20260928 20:17:39.583843 8218 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:39.583600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:59979)
0928 20:17:39.583764 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:39.583801 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148,"thread_start_us":104,"threads_started":1}
I20260928 20:17:39.706557 8219 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:39.706258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:47517)
0928 20:17:39.706472 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:39.706512 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":128,"threads_started":1}
I20260928 20:17:40.399384 8220 raft_consensus.cc:482] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:40.399498 8220 raft_consensus.cc:504] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "810ef3376e6b42a49934fd5e7a638aa7" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 36891 } } peers { permanent_uuid: "e6bb2d42b3eb43e7a798435b23ec1479" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 38809 } } peers { permanent_uuid: "c6630a8999d34a98b97f557a544221fd" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 36375 } }
I20260928 20:17:40.399679 8220 leader_election.cc:288] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891), e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809)
W20260928 20:17:40.400147 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 810ef3376e6b42a49934fd5e7a638aa7 (127.24.190.3:36891): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
W20260928 20:17:40.400224 7796 leader_election.cc:341] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer e6bb2d42b3eb43e7a798435b23ec1479 (127.24.190.2:38809): Not found: Tablet not found: b96d4103e2ee428593c4e01e2765dd81
I20260928 20:17:40.400244 7796 leader_election.cc:302] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6630a8999d34a98b97f557a544221fd; no voters: 810ef3376e6b42a49934fd5e7a638aa7, e6bb2d42b3eb43e7a798435b23ec1479
I20260928 20:17:40.400329 8220 raft_consensus.cc:2726] T b96d4103e2ee428593c4e01e2765dd81 P c6630a8999d34a98b97f557a544221fd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:17:40.499590 8221 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:40.499341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:50815)
0928 20:17:40.499489 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:40.499533 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127,"thread_start_us":62,"threads_started":1}
I20260928 20:17:40.584601 8222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:40.584364 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:35907)
0928 20:17:40.584499 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:40.584542 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":65,"threads_started":1}
I20260928 20:17:40.707288 8223 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:40.707069 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:59087)
0928 20:17:40.707201 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:40.707243 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":63,"threads_started":1}
I20260928 20:17:41.500370 8224 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:41.500086 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:41417)
0928 20:17:41.500264 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:41.500310 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":81,"threads_started":1}
I20260928 20:17:41.585350 8225 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:41.585105 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:33595)
0928 20:17:41.585261 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:41.585302 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":135,"thread_start_us":64,"threads_started":1}
I20260928 20:17:41.707942 8226 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:41.707720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:56197)
0928 20:17:41.707858 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:41.707897 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260928 20:17:42.501216 8227 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:42.500989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.1:55649)
0928 20:17:42.501137 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:42.501173 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130,"thread_start_us":86,"threads_started":1}
I20260928 20:17:42.586123 8228 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:42.585905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.2:35495)
0928 20:17:42.586039 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:42.586077 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":77,"threads_started":1}
I20260928 20:17:42.708626 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 7748
I20260928 20:17:42.709421 8229 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:42.708643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:42573 (local address 127.24.190.3:55797)
0928 20:17:42.709330 (+ 687us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:42.709371 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:42573: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":665,"thread_start_us":78,"threads_started":1}
I20260928 20:17:42.713544 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 7912
I20260928 20:17:42.718096 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8044
2026-09-28T20:17:42Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (18524 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:17:42 dist-test-slave-n45k krb5kdc[8232](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:17:42 dist-test-slave-n45k krb5kdc[8232](info): set up 2 sockets
Sep 28 20:17:42 dist-test-slave-n45k krb5kdc[8232](info): commencing operation
krb5kdc: starting...
W20260928 20:17:43.758785 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.020s user 0.004s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:17:43 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:17:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:17:43Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:17:43.877620 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43023
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:43.958869 8245 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:43.959079 8245 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:43.959101 8245 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:43.960330 8245 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260928 20:17:43.960373 8245 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260928 20:17:43.960386 8245 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260928 20:17:43.960397 8245 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:17:43.960412 8245 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:43.960470 8245 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:43.960487 8245 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:17:43.960508 8245 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:17:43.961987 8245 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8245
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:43.962236 8245 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:43.962505 8245 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:43.967839 8253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:43.967941 8245 server_base.cc:1034] running on GCE node
W20260928 20:17:43.967845 8250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:43.967854 8251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:43.968384 8245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:43.968681 8245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:43.969835 8245 hybrid_clock.cc:648] HybridClock initialized: now 1790626663969822 us; error 30 us; skew 500 ppm
Sep 28 20:17:43 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626663, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:43.972612 8245 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:17:43.973050 8245 webserver.cc:460] Webserver started at http://127.24.190.62:35055/ using document root <none> and password file <none>
I20260928 20:17:43.973294 8245 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:43.973340 8245 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:43.973493 8245 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:43.974643 8245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a"
format_stamp: "Formatted at 2026-09-28 20:17:43 on dist-test-slave-n45k"
server_key: "8eb274d0d4398bfbb7658f304e3fb93e"
server_key_iv: "170036e444d58d4660185a27c7e44072"
server_key_version: "encryptionkey@0"
I20260928 20:17:43.975005 8245 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a"
format_stamp: "Formatted at 2026-09-28 20:17:43 on dist-test-slave-n45k"
server_key: "8eb274d0d4398bfbb7658f304e3fb93e"
server_key_iv: "170036e444d58d4660185a27c7e44072"
server_key_version: "encryptionkey@0"
I20260928 20:17:43.976323 8245 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:43.977052 8260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:43.977296 8245 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:43.977399 8245 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a"
format_stamp: "Formatted at 2026-09-28 20:17:43 on dist-test-slave-n45k"
server_key: "8eb274d0d4398bfbb7658f304e3fb93e"
server_key_iv: "170036e444d58d4660185a27c7e44072"
server_key_version: "encryptionkey@0"
I20260928 20:17:43.977478 8245 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:43.993942 8245 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:43.996968 8245 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:43.997135 8245 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:44.001286 8245 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43023
I20260928 20:17:44.001358 8312 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43023 every 8 connection(s)
I20260928 20:17:44.001677 8245 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:17:44.002591 8313 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:44.003153 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8245
I20260928 20:17:44.003257 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:17:44.003434 25336 external_mini_cluster.cc:1428] Setting key a4985efafe13a1d19d4fa51a64159314
I20260928 20:17:44.005693 8313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap starting.
I20260928 20:17:44.006343 8313 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:44.006623 8313 log.cc:824] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:44.007364 8313 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: No bootstrap required, opened a new log
I20260928 20:17:44.009750 8313 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:17:44.009929 8313 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:44.009958 8313 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995b2e7dafc4e1da9212fc7d4e43b3a, State: Initialized, Role: FOLLOWER
I20260928 20:17:44.010099 8313 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:17:44.010174 8313 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:17:44.010196 8313 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:17:44.010299 8313 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 0 FOLLOWER]: Advancing to term 1
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626663, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:44.010895 8313 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:17:44.011016 8313 leader_election.cc:302] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7995b2e7dafc4e1da9212fc7d4e43b3a; no voters:
I20260928 20:17:44.011212 8313 leader_election.cc:288] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:17:44.011240 8318 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:44.011358 8318 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 LEADER]: Becoming Leader. State: Replica: 7995b2e7dafc4e1da9212fc7d4e43b3a, State: Running, Role: LEADER
I20260928 20:17:44.011445 8318 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:17:44.011508 8313 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:17:44.011794 8319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } } }
I20260928 20:17:44.011871 8319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:44.012001 8319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7995b2e7dafc4e1da9212fc7d4e43b3a. Latest consensus state: current_term: 1 leader_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } } }
I20260928 20:17:44.012056 8319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: This master's current role is: LEADER
I20260928 20:17:44.012298 8323 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:17:44.012861 8323 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:17:44.014959 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.003951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59084 (local address 127.24.190.62:43023)
0928 20:17:44.004131 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.004140 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.004175 (+ 35us) server_negotiation.cc:407] Connection header received
0928 20:17:44.004608 (+ 433us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.004614 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.004661 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.004777 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:44.005533 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.006614 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.007638 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.008049 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.008240 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.011055 (+ 2815us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:44.011060 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:44.011060 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:44.011071 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:44.013373 (+ 2302us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.013809 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.013812 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.013812 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.013908 (+ 96us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.014106 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.014107 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.014107 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.014425 (+ 318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:44.014550 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.014686 (+ 136us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.014823 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123,"thread_start_us":79,"threads_started":1}
I20260928 20:17:44.019244 8323 catalog_manager.cc:1347] Generated new cluster ID: 3da036192a394c628a7ded7f384dc0b2
I20260928 20:17:44.019305 8323 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:17:44.027380 8323 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:17:44.028085 8323 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:17:44.033746 8323 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Generated new TSK 0
I20260928 20:17:44.033926 8323 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:17:44.069265 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43023
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:44.151643 8339 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:44.151880 8339 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:44.151916 8339 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:44.153095 8339 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:44.153160 8339 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:44.153204 8339 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:17:44.154770 8339 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8339
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:44.155023 8339 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:44.155248 8339 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:44.160140 8345 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:44.160148 8344 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:44.160148 8347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:44.160384 8339 server_base.cc:1034] running on GCE node
I20260928 20:17:44.160580 8339 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:44.160851 8339 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:44.162005 8339 hybrid_clock.cc:648] HybridClock initialized: now 1790626664161991 us; error 25 us; skew 500 ppm
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626664, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:44.164639 8339 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:17:44.165133 8339 webserver.cc:460] Webserver started at http://127.24.190.1:35299/ using document root <none> and password file <none>
I20260928 20:17:44.165360 8339 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:44.165426 8339 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:44.165571 8339 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:44.166635 8339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "c3811cbac8f4461bb074392178cf1847"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "1a7e6307bcff61da057905e9fe99da9c"
server_key_iv: "474db41342e76d88922893aa5bf952ea"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.166992 8339 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "c3811cbac8f4461bb074392178cf1847"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "1a7e6307bcff61da057905e9fe99da9c"
server_key_iv: "474db41342e76d88922893aa5bf952ea"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.168253 8339 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:44.169034 8354 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.169322 8339 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:44.169418 8339 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c3811cbac8f4461bb074392178cf1847"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "1a7e6307bcff61da057905e9fe99da9c"
server_key_iv: "474db41342e76d88922893aa5bf952ea"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.169492 8339 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:44.179797 8339 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:44.182224 8339 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:44.182416 8339 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:44.182638 8339 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:44.182945 8339 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:44.182999 8339 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.183039 8339 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:44.183065 8339 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.188822 8339 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:46625
I20260928 20:17:44.188875 8467 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:46625 every 8 connection(s)
I20260928 20:17:44.189162 8339 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:17:44.194494 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8339
I20260928 20:17:44.194620 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:17:44.194815 25336 external_mini_cluster.cc:1428] Setting key 3054492d96d54bf02f532fc3d4b3f0b6
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626664, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:44.199075 8470 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.189798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:52189)
0928 20:17:44.189946 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.189985 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.190501 (+ 516us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.190710 (+ 209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.190714 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.191247 (+ 533us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:44.191427 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.191431 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.192118 (+ 687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.192119 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.192958 (+ 839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.192960 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.193347 (+ 387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.193348 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.193449 (+ 101us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.194006 (+ 557us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:44.194013 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:44.195675 (+ 1662us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:44.197521 (+ 1846us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:44.197528 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:44.197531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:44.197897 (+ 366us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:44.198138 (+ 241us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:44.198139 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:44.198139 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:44.198313 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:44.198609 (+ 296us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:44.198614 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:44.198730 (+ 116us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.198808 (+ 78us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.198921 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260928 20:17:44.199252 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.189836 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:52189 (local address 127.24.190.62:43023)
0928 20:17:44.189877 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.189879 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.190073 (+ 194us) server_negotiation.cc:407] Connection header received
0928 20:17:44.190586 (+ 513us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.190587 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.190596 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.190655 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:44.191502 (+ 847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.192006 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.193059 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.193265 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.193330 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.195781 (+ 2451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:44.195782 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:44.195782 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:44.195790 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:44.197428 (+ 1638us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.197993 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.197994 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.197995 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.198054 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.198384 (+ 330us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.198385 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.198386 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.198542 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:44.198614 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.198911 (+ 297us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.199008 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:17:44.202380 8468 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43023
I20260928 20:17:44.202491 8468 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:44.202713 8468 heartbeater.cc:511] Master 127.24.190.62:43023 requested a full tablet report, sending...
I20260928 20:17:44.203307 8277 ts_manager.cc:194] Registered new tserver with Master: c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625)
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:17:44.204186 8277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:52189
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:17:44.222043 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43023
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:44.303293 8473 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:44.303488 8473 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:44.303510 8473 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:44.304679 8473 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:44.304721 8473 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:44.304747 8473 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:17:44.306089 8473 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:44.306258 8473 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:44.306535 8473 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:44.311590 8479 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:44.311573 8478 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:44.311766 8473 server_base.cc:1034] running on GCE node
W20260928 20:17:44.311550 8481 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:44.312017 8473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:44.312250 8473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:44.313412 8473 hybrid_clock.cc:648] HybridClock initialized: now 1790626664313405 us; error 30 us; skew 500 ppm
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626664, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:44.316076 8473 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:17:44.316584 8473 webserver.cc:460] Webserver started at http://127.24.190.2:36221/ using document root <none> and password file <none>
I20260928 20:17:44.316833 8473 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:44.316905 8473 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:44.317052 8473 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:44.318156 8473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "9c7e28faf2374c9e9986f451d14b5240"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "dc2735e7db1f44150da69d39d5345ac4"
server_key_iv: "25cb6d74a96686a4572264034d2588f1"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.318574 8473 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "9c7e28faf2374c9e9986f451d14b5240"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "dc2735e7db1f44150da69d39d5345ac4"
server_key_iv: "25cb6d74a96686a4572264034d2588f1"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.319947 8473 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:44.320742 8488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.321043 8473 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:17:44.321247 8473 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "9c7e28faf2374c9e9986f451d14b5240"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "dc2735e7db1f44150da69d39d5345ac4"
server_key_iv: "25cb6d74a96686a4572264034d2588f1"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.321338 8473 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:44.339627 8473 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:44.342355 8473 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:44.342526 8473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:44.342792 8473 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:44.343133 8473 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:44.343170 8473 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.343227 8473 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:44.343259 8473 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.349725 8473 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:33995
I20260928 20:17:44.349799 8601 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:33995 every 8 connection(s)
I20260928 20:17:44.350167 8473 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626664, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:44.357352 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8473
I20260928 20:17:44.357496 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:17:44.357725 25336 external_mini_cluster.cc:1428] Setting key f60d1fcdf1356e3f278cb713ff1e70ee
I20260928 20:17:44.360391 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.350983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:51539 (local address 127.24.190.62:43023)
0928 20:17:44.351077 (+ 94us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.351080 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.351355 (+ 275us) server_negotiation.cc:407] Connection header received
0928 20:17:44.351870 (+ 515us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.351871 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.351881 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.351934 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:44.352923 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.353417 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.354599 (+ 1182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.354789 (+ 190us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.354845 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.357119 (+ 2274us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:44.357120 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:44.357121 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:44.357127 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:44.358914 (+ 1787us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.359338 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.359339 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.359340 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.359401 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.359649 (+ 248us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.359650 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.359651 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.359809 (+ 158us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:44.359879 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.360199 (+ 320us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.360293 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260928 20:17:44.360579 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.350938 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:51539)
0928 20:17:44.351137 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.351256 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.351774 (+ 518us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.351993 (+ 219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.351997 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.352624 (+ 627us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:44.352834 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.352839 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.353513 (+ 674us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.353514 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.354521 (+ 1007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.354524 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.354866 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.354867 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.354972 (+ 105us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.355587 (+ 615us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:44.355596 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:44.357016 (+ 1420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:44.359000 (+ 1984us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:44.359006 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:44.359008 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:44.359265 (+ 257us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:44.359469 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:44.359470 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:44.359470 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:44.359585 (+ 115us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:44.359876 (+ 291us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:44.359880 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:44.360002 (+ 122us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.360146 (+ 144us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.360319 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":114,"threads_started":1}
I20260928 20:17:44.361426 8602 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43023
I20260928 20:17:44.361536 8602 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:44.361732 8602 heartbeater.cc:511] Master 127.24.190.62:43023 requested a full tablet report, sending...
I20260928 20:17:44.362126 8277 ts_manager.cc:194] Registered new tserver with Master: 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
I20260928 20:17:44.362686 8277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:51539
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:17:44.385571 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43023
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:17:44.466145 8607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:17:44.466379 8607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:17:44.466403 8607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:17:44.467573 8607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:17:44.467618 8607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:17:44.467644 8607 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:17:44.469099 8607 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8607
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:17:44.469367 8607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:17:44.469601 8607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:17:44.475160 8615 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:44.475191 8612 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:17:44.475204 8613 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:17:44.475520 8607 server_base.cc:1034] running on GCE node
I20260928 20:17:44.475723 8607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:17:44.475992 8607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:17:44.477254 8607 hybrid_clock.cc:648] HybridClock initialized: now 1790626664477230 us; error 32 us; skew 500 ppm
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626664, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:17:44.479838 8607 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:17:44.480450 8607 webserver.cc:460] Webserver started at http://127.24.190.3:46475/ using document root <none> and password file <none>
I20260928 20:17:44.480712 8607 fs_manager.cc:359] Metadata directory not provided
I20260928 20:17:44.480785 8607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:17:44.480942 8607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:17:44.482116 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "13c163ccd4b04d0794b2bf998eb1785c"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "eab9f214ec675c0fce2d207b39a333e5"
server_key_iv: "2d87b11040bf5b84167d54b88523df19"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.482537 8607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "13c163ccd4b04d0794b2bf998eb1785c"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "eab9f214ec675c0fce2d207b39a333e5"
server_key_iv: "2d87b11040bf5b84167d54b88523df19"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.483937 8607 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:17:44.484753 8622 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.484928 8607 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.485034 8607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "13c163ccd4b04d0794b2bf998eb1785c"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "eab9f214ec675c0fce2d207b39a333e5"
server_key_iv: "2d87b11040bf5b84167d54b88523df19"
server_key_version: "encryptionkey@0"
I20260928 20:17:44.485117 8607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:17:44.492787 8607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:17:44.494660 8607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:17:44.494822 8607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:17:44.495043 8607 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:17:44.495352 8607 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:17:44.495411 8607 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.495455 8607 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:17:44.495486 8607 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:17:44.501703 8607 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:35367
I20260928 20:17:44.501741 8735 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:35367 every 8 connection(s)
I20260928 20:17:44.502077 8607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:17:44 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626664, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:17:44.510520 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8607
I20260928 20:17:44.510697 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:17:44.510944 25336 external_mini_cluster.cc:1428] Setting key c093d83ec64d7625e4070a51138919cf
I20260928 20:17:44.511582 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.502813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:45263 (local address 127.24.190.62:43023)
0928 20:17:44.502888 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.502890 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.503037 (+ 147us) server_negotiation.cc:407] Connection header received
0928 20:17:44.503533 (+ 496us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.503534 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.503543 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.503581 (+ 38us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:44.504507 (+ 926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.504997 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.506090 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.506369 (+ 279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.506423 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.508603 (+ 2180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:44.508604 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:44.508605 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:44.508611 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:44.510014 (+ 1403us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.510506 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.510507 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.510507 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.510558 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.510869 (+ 311us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.510870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.510871 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.510973 (+ 102us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:44.511056 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.511414 (+ 358us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.511493 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 20:17:44.511750 8738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.502765 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:45263)
0928 20:17:44.502916 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.502952 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.503437 (+ 485us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.503643 (+ 206us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.503646 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.504231 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:17:44.504429 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.504434 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.505082 (+ 648us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.505082 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.506012 (+ 930us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.506014 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.506444 (+ 430us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.506445 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.506555 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.507025 (+ 470us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:17:44.507033 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:17:44.508518 (+ 1485us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:17:44.510092 (+ 1574us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:44.510097 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:44.510099 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:44.510420 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:44.510636 (+ 216us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:17:44.510638 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:17:44.510638 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:17:44.510789 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:17:44.511061 (+ 272us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:17:44.511067 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:17:44.511227 (+ 160us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.511345 (+ 118us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.511506 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":89,"threads_started":1}
I20260928 20:17:44.512357 8736 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43023
I20260928 20:17:44.512467 8736 heartbeater.cc:464] Registering TS with master...
I20260928 20:17:44.512638 8736 heartbeater.cc:511] Master 127.24.190.62:43023 requested a full tablet report, sending...
I20260928 20:17:44.513041 8277 ts_manager.cc:194] Registered new tserver with Master: 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367)
I20260928 20:17:44.513451 8277 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:45263
I20260928 20:17:44.522948 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:17:44.530586 8316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.524493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59086 (local address 127.24.190.62:43023)
0928 20:17:44.524574 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.524577 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.524648 (+ 71us) server_negotiation.cc:407] Connection header received
0928 20:17:44.524723 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.524724 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.524736 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.524795 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:17:44.525445 (+ 650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.525923 (+ 478us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.526724 (+ 801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.526919 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.527002 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.528171 (+ 1169us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:17:44.528172 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:17:44.528172 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:17:44.528179 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:17:44.529380 (+ 1201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.529731 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.529732 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.529733 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.529791 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:17:44.529986 (+ 195us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:17:44.529987 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:17:44.529988 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:17:44.530139 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:17:44.530269 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.530400 (+ 131us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.530479 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260928 20:17:44.532119 8277 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59086:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:17:44.533690 8277 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:17:44.540228 8748 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.535976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33995 (local address 127.0.0.1:47672)
0928 20:17:44.536347 (+ 371us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.536390 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.536457 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.536685 (+ 228us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.536688 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.536690 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:44.536813 (+ 123us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.536816 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.538096 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.538097 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.539195 (+ 1098us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.539197 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.539876 (+ 679us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.539877 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.539967 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.539980 (+ 13us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.540097 (+ 117us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.540152 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":343,"mutex_wait_us":4,"thread_start_us":67,"threads_started":1}
I20260928 20:17:44.540233 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.536138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47672 (local address 127.24.190.2:33995)
0928 20:17:44.536521 (+ 383us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.536526 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.536536 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:44.536572 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.536574 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.536588 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.536683 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:44.536904 (+ 221us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.537991 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.539289 (+ 1298us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.539784 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.539876 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.539937 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.540116 (+ 179us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.540159 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":347,"thread_start_us":109,"threads_started":1}
I20260928 20:17:44.540383 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.536081 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42468 (local address 127.24.190.3:35367)
0928 20:17:44.536325 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.536329 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.536534 (+ 205us) server_negotiation.cc:407] Connection header received
0928 20:17:44.536583 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.536585 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.536597 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.536675 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:44.536873 (+ 198us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.537705 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.539224 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.539918 (+ 694us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.539984 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.540033 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.540263 (+ 230us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.540304 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":204,"thread_start_us":82,"threads_started":1}
I20260928 20:17:44.540578 8747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.535978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:35367 (local address 127.0.0.1:42468)
0928 20:17:44.536364 (+ 386us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.536389 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.536474 (+ 85us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.536696 (+ 222us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.536697 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.536699 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:44.536778 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.536780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.537820 (+ 1040us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.537820 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.539141 (+ 1321us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.539144 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.540085 (+ 941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.540086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.540149 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.540152 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.540471 (+ 319us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.540506 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":50,"threads_started":1}
I20260928 20:17:44.540656 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.536320 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35644 (local address 127.24.190.1:46625)
0928 20:17:44.536501 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.536505 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.536901 (+ 396us) server_negotiation.cc:407] Connection header received
0928 20:17:44.536947 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.536949 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.536963 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.537029 (+ 66us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:44.537253 (+ 224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.538262 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.539472 (+ 1210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.540204 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.540263 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.540313 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.540546 (+ 233us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.540583 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":143,"thread_start_us":82,"threads_started":1}
I20260928 20:17:44.540828 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.536171 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46625 (local address 127.0.0.1:35644)
0928 20:17:44.536764 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.536794 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.536843 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.537108 (+ 265us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.537109 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.537111 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:44.537162 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.537163 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.538395 (+ 1232us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.538396 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.539380 (+ 984us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.539382 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.540345 (+ 963us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.540346 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.540413 (+ 67us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.540416 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.540467 (+ 51us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.540505 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":76,"threads_started":1}
I20260928 20:17:44.541347 8536 tablet_service.cc:1467] Processing CreateTablet for tablet 044251649ce44a688f062468757aed8b (DEFAULT_TABLE table=test-table [id=2094465cd870435d8218844201b1df2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:44.541347 8670 tablet_service.cc:1467] Processing CreateTablet for tablet 044251649ce44a688f062468757aed8b (DEFAULT_TABLE table=test-table [id=2094465cd870435d8218844201b1df2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:44.541420 8402 tablet_service.cc:1467] Processing CreateTablet for tablet 044251649ce44a688f062468757aed8b (DEFAULT_TABLE table=test-table [id=2094465cd870435d8218844201b1df2c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:17:44.541667 8402 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 044251649ce44a688f062468757aed8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:44.541673 8536 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 044251649ce44a688f062468757aed8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:44.541673 8670 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 044251649ce44a688f062468757aed8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:17:44.544358 8753 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Bootstrap starting.
I20260928 20:17:44.545030 8753 tablet_bootstrap.cc:654] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:44.545024 8754 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Bootstrap starting.
I20260928 20:17:44.545650 8753 log.cc:824] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:44.545792 8754 tablet_bootstrap.cc:654] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:44.546396 8754 log.cc:824] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:44.546449 8755 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Bootstrap starting.
I20260928 20:17:44.546619 8753 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: No bootstrap required, opened a new log
I20260928 20:17:44.546692 8753 ts_tablet_manager.cc:1397] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:17:44.547631 8755 tablet_bootstrap.cc:654] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Neither blocks nor log segments found. Creating new log.
I20260928 20:17:44.547997 8754 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: No bootstrap required, opened a new log
I20260928 20:17:44.548094 8754 ts_tablet_manager.cc:1397] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s
I20260928 20:17:44.548281 8755 log.cc:824] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Log is configured to *not* fsync() on all Append() calls
I20260928 20:17:44.549096 8755 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: No bootstrap required, opened a new log
I20260928 20:17:44.549170 8755 ts_tablet_manager.cc:1397] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s
I20260928 20:17:44.549422 8753 raft_consensus.cc:348] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.549602 8753 raft_consensus.cc:374] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:44.549669 8753 raft_consensus.cc:729] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3811cbac8f4461bb074392178cf1847, State: Initialized, Role: FOLLOWER
I20260928 20:17:44.549801 8753 consensus_queue.cc:260] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.550107 8753 ts_tablet_manager.cc:1428] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260928 20:17:44.550242 8468 heartbeater.cc:503] Master 127.24.190.62:43023 was elected leader, sending a full tablet report...
I20260928 20:17:44.550177 8754 raft_consensus.cc:348] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.550362 8754 raft_consensus.cc:374] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:44.550400 8754 raft_consensus.cc:729] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13c163ccd4b04d0794b2bf998eb1785c, State: Initialized, Role: FOLLOWER
I20260928 20:17:44.550504 8754 consensus_queue.cc:260] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.550925 8754 ts_tablet_manager.cc:1428] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 20:17:44.551016 8736 heartbeater.cc:503] Master 127.24.190.62:43023 was elected leader, sending a full tablet report...
I20260928 20:17:44.551409 8755 raft_consensus.cc:348] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.551607 8755 raft_consensus.cc:374] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:17:44.551646 8755 raft_consensus.cc:729] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c7e28faf2374c9e9986f451d14b5240, State: Initialized, Role: FOLLOWER
I20260928 20:17:44.551781 8755 consensus_queue.cc:260] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.552068 8755 ts_tablet_manager.cc:1428] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:17:44.552150 8602 heartbeater.cc:503] Master 127.24.190.62:43023 was elected leader, sending a full tablet report...
W20260928 20:17:44.600800 8603 tablet.cc:2369] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:17:44.689858 8469 tablet.cc:2369] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:17:44.752732 8737 tablet.cc:2369] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:17:44.837893 8761 raft_consensus.cc:482] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:17:44.838065 8761 raft_consensus.cc:504] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.838551 8761 leader_election.cc:288] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625)
I20260928 20:17:44.841332 8604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.838768 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46625 (local address 127.24.190.2:33791)
0928 20:17:44.838835 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.838847 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.838896 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.839054 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.839055 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.839057 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:44.839133 (+ 76us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.839135 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.839784 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.839785 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.840535 (+ 750us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.840537 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.841069 (+ 532us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.841070 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.841154 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.841157 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.841225 (+ 68us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.841264 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":47}
I20260928 20:17:44.841332 8752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.838828 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33791 (local address 127.24.190.1:46625)
0928 20:17:44.838871 (+ 43us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.838873 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.838883 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:17:44.838966 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.838967 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.838985 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.839048 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:44.839210 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.839680 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.840636 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.840988 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.841072 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.841080 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.841233 (+ 153us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.841267 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:17:44.841591 8749 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.838817 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:59093 (local address 127.24.190.3:35367)
0928 20:17:44.838867 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.838869 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.839003 (+ 134us) server_negotiation.cc:407] Connection header received
0928 20:17:44.839173 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.839174 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.839183 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.839255 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:17:44.839410 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.839873 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.840805 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.841224 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.841314 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.841322 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.841482 (+ 160us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.841531 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:17:44.841610 8762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.838770 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:35367 (local address 127.24.190.2:59093)
0928 20:17:44.838917 (+ 147us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.838927 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:17:44.839019 (+ 92us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:17:44.839261 (+ 242us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:17:44.839261 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:17:44.839263 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:17:44.839340 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.839341 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.839957 (+ 616us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.839958 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.840700 (+ 742us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:17:44.840702 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.841314 (+ 612us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.841315 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:17:44.841412 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.841416 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:17:44.841474 (+ 58us) client_negotiation.cc:240] Negotiation successful
0928 20:17:44.841523 (+ 49us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":13,"thread_start_us":66,"threads_started":1}
I20260928 20:17:44.841637 8422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "044251649ce44a688f062468757aed8b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3811cbac8f4461bb074392178cf1847" is_pre_election: true
I20260928 20:17:44.841796 8422 raft_consensus.cc:2454] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 0.
I20260928 20:17:44.841944 8690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "044251649ce44a688f062468757aed8b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13c163ccd4b04d0794b2bf998eb1785c" is_pre_election: true
I20260928 20:17:44.842031 8490 leader_election.cc:302] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c7e28faf2374c9e9986f451d14b5240, c3811cbac8f4461bb074392178cf1847; no voters:
I20260928 20:17:44.842125 8690 raft_consensus.cc:2454] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 0.
I20260928 20:17:44.842156 8761 raft_consensus.cc:2781] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:17:44.842213 8761 raft_consensus.cc:482] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:17:44.842381 8761 raft_consensus.cc:3037] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:44.843151 8761 raft_consensus.cc:504] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.843333 8761 leader_election.cc:288] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 election: Requested vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625)
I20260928 20:17:44.843444 8690 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "044251649ce44a688f062468757aed8b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13c163ccd4b04d0794b2bf998eb1785c"
I20260928 20:17:44.843490 8422 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "044251649ce44a688f062468757aed8b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3811cbac8f4461bb074392178cf1847"
I20260928 20:17:44.843530 8690 raft_consensus.cc:3037] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:44.843555 8422 raft_consensus.cc:3037] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:17:44.844390 8690 raft_consensus.cc:2454] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 1.
I20260928 20:17:44.844390 8422 raft_consensus.cc:2454] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 1.
I20260928 20:17:44.844564 8490 leader_election.cc:302] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c7e28faf2374c9e9986f451d14b5240, c3811cbac8f4461bb074392178cf1847; no voters:
I20260928 20:17:44.844671 8761 raft_consensus.cc:2781] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:17:44.844868 8761 raft_consensus.cc:686] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 LEADER]: Becoming Leader. State: Replica: 9c7e28faf2374c9e9986f451d14b5240, State: Running, Role: LEADER
I20260928 20:17:44.844969 8761 consensus_queue.cc:237] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:17:44.845840 8276 catalog_manager.cc:5495] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "9c7e28faf2374c9e9986f451d14b5240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } health_report { overall_health: UNKNOWN } } }
I20260928 20:17:44.894784 8750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.892037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47682 (local address 127.24.190.2:33995)
0928 20:17:44.892213 (+ 176us) server_negotiation.cc:206] Beginning negotiation
0928 20:17:44.892219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:17:44.892227 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:17:44.892264 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:17:44.892265 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:17:44.892285 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:17:44.892345 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:17:44.892572 (+ 227us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.893128 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.893909 (+ 781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:17:44.894101 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:17:44.894159 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:17:44.894392 (+ 233us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:17:44.894488 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:17:44.894551 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:17:44.894638 (+ 87us) server_negotiation.cc:299] Negotiation successful
0928 20:17:44.894656 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148}
I20260928 20:17:44.896659 8422 raft_consensus.cc:1261] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Refusing update from remote peer 9c7e28faf2374c9e9986f451d14b5240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:44.896668 8690 raft_consensus.cc:1261] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Refusing update from remote peer 9c7e28faf2374c9e9986f451d14b5240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:17:44.897034 8763 consensus_queue.cc:1035] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:44.897183 8761 consensus_queue.cc:1035] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:17:44.899473 8766 mvcc.cc:205] Tried to move back new op lower bound from 7334406819414134784 to 7334406819205722112. Current Snapshot: MvccSnapshot[applied={T|T < 7334406819414134784}]
I20260928 20:17:44.899675 8768 mvcc.cc:205] Tried to move back new op lower bound from 7334406819414134784 to 7334406819205722112. Current Snapshot: MvccSnapshot[applied={T|T < 7334406819414134784}]
I20260928 20:17:44.902091 8276 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:44.902180 8276 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59086:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:17:44.903002 8276 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Sending DeleteTablet for 3 replicas of tablet 044251649ce44a688f062468757aed8b
I20260928 20:17:44.903321 8670 tablet_service.cc:1514] Processing DeleteTablet for tablet 044251649ce44a688f062468757aed8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:44 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:42468
I20260928 20:17:44.903376 8536 tablet_service.cc:1514] Processing DeleteTablet for tablet 044251649ce44a688f062468757aed8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:44 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:47672
I20260928 20:17:44.903456 8402 tablet_service.cc:1514] Processing DeleteTablet for tablet 044251649ce44a688f062468757aed8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:44 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:35644
I20260928 20:17:44.903501 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8339
I20260928 20:17:44.908401 8775 tablet_replica.cc:330] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: stopping tablet replica
I20260928 20:17:44.908511 8776 tablet_replica.cc:330] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: stopping tablet replica
I20260928 20:17:44.908565 8775 raft_consensus.cc:2229] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260928 20:17:44.908650 8262 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:46625 (error 108)
I20260928 20:17:44.908704 8775 raft_consensus.cc:2258] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:44.908730 8776 raft_consensus.cc:2229] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:17:44.908948 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8473
I20260928 20:17:44.908959 8776 raft_consensus.cc:2258] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:17:44.909873 8775 ts_tablet_manager.cc:1905] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:17:44.911326 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.911191 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46625 (local address 127.0.0.1:35660)
0928 20:17:44.911255 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.911297 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:46625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260928 20:17:44.911466 8262 catalog_manager.cc:4584] TS c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 044251649ce44a688f062468757aed8b: Network error: Client connection negotiation failed: client connection to 127.24.190.1:46625: connect: Connection refused (error 111)
I20260928 20:17:44.912108 8775 ts_tablet_manager.cc:1918] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:17:44.912189 8775 log.cc:1196] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/044251649ce44a688f062468757aed8b
I20260928 20:17:44.912511 8775 ts_tablet_manager.cc:1939] T 044251649ce44a688f062468757aed8b P 13c163ccd4b04d0794b2bf998eb1785c: Deleting consensus metadata
I20260928 20:17:44.912966 8261 catalog_manager.cc:4841] TS 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): tablet 044251649ce44a688f062468757aed8b (table test-table [id=2094465cd870435d8218844201b1df2c]) successfully deleted
I20260928 20:17:44.915017 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8607
I20260928 20:17:44.915341 8751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:17:44.915024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33995 (local address 127.0.0.1:47688)
0928 20:17:44.915268 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0928 20:17:44.915305 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.2:33995: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":221}
I20260928 20:17:44.919847 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8245
I20260928 20:18:04.925541 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43023
--webserver_interface=127.24.190.62
--webserver_port=35055
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:05.007483 8778 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:05.007805 8778 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:05.007849 8778 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:05.010177 8778 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260928 20:18:05.010264 8778 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260928 20:18:05.010313 8778 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260928 20:18:05.010344 8778 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:05.010382 8778 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:05.010422 8778 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:05.010456 8778 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:05.010543 8778 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:05.013459 8778 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=35055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8778
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:05.013782 8778 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:05.014096 8778 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:05.023403 8785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.023466 8787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.023403 8784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:05.023824 8778 server_base.cc:1034] running on GCE node
I20260928 20:18:05.024134 8778 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:05.024506 8778 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:05.025686 8778 hybrid_clock.cc:648] HybridClock initialized: now 1790626685025669 us; error 45 us; skew 500 ppm
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:05.028317 8778 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:18:05.028846 8778 webserver.cc:460] Webserver started at http://127.24.190.62:35055/ using document root <none> and password file <none>
I20260928 20:18:05.029093 8778 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:05.029176 8778 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:05.030637 8778 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:18:05.031414 8794 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.031598 8778 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:05.031740 8778 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a"
format_stamp: "Formatted at 2026-09-28 20:17:43 on dist-test-slave-n45k"
server_key: "8eb274d0d4398bfbb7658f304e3fb93e"
server_key_iv: "170036e444d58d4660185a27c7e44072"
server_key_version: "encryptionkey@0"
I20260928 20:18:05.032156 8778 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:05.055254 8778 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:05.057549 8778 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:05.057745 8778 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:05.062304 8778 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43023
I20260928 20:18:05.062440 8846 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43023 every 8 connection(s)
I20260928 20:18:05.062785 8778 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:05.064532 8847 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:18:05.065234 8847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap starting.
I20260928 20:18:05.071122 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8778
I20260928 20:18:05.071511 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:46625
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:43023
--webserver_port=35299
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:18:05.075484 8847 log.cc:824] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:05.078500 8847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:18:05.078859 8847 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap complete.
I20260928 20:18:05.081399 8847 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:05.081641 8847 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995b2e7dafc4e1da9212fc7d4e43b3a, State: Initialized, Role: FOLLOWER
I20260928 20:18:05.081830 8847 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:05.081893 8847 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:05.081966 8847 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:05.082021 8847 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 1 FOLLOWER]: Advancing to term 2
I20260928 20:18:05.083241 8847 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:05.083374 8847 leader_election.cc:302] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7995b2e7dafc4e1da9212fc7d4e43b3a; no voters:
I20260928 20:18:05.083554 8847 leader_election.cc:288] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260928 20:18:05.083613 8851 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Leader election won for term 2
I20260928 20:18:05.083771 8851 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 LEADER]: Becoming Leader. State: Replica: 7995b2e7dafc4e1da9212fc7d4e43b3a, State: Running, Role: LEADER
I20260928 20:18:05.083854 8847 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:05.083870 8851 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:05.084201 8851 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7995b2e7dafc4e1da9212fc7d4e43b3a. Latest consensus state: current_term: 2 leader_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } } }
I20260928 20:18:05.084263 8852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } } }
I20260928 20:18:05.084501 8852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:05.084285 8851 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:05.084758 8860 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:05.085646 8860 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:05.085765 8860 catalog_manager.cc:1259] Loaded cluster ID: 3da036192a394c628a7ded7f384dc0b2
I20260928 20:18:05.085812 8860 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:05.087122 8860 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:05.087317 8860 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Loaded TSK: 0
I20260928 20:18:05.104123 8860 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Generated new TSK 1
I20260928 20:18:05.104442 8860 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 20:18:05.161082 8849 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:05.161319 8849 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:05.161360 8849 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:05.162598 8849 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:05.162659 8849 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:05.162712 8849 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:05.164186 8849 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:46625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=35299
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.8849
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:05.164450 8849 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:05.164685 8849 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:05.169916 8877 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.169939 8874 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.169953 8875 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:05.170455 8849 server_base.cc:1034] running on GCE node
I20260928 20:18:05.170662 8849 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:05.170926 8849 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:05.172123 8849 hybrid_clock.cc:648] HybridClock initialized: now 1790626685172107 us; error 27 us; skew 500 ppm
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:05.174777 8849 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:18:05.175335 8849 webserver.cc:460] Webserver started at http://127.24.190.1:35299/ using document root <none> and password file <none>
I20260928 20:18:05.175593 8849 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:05.175652 8849 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:05.177034 8849 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:05.177713 8884 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.177886 8849 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:05.177989 8849 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c3811cbac8f4461bb074392178cf1847"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "1a7e6307bcff61da057905e9fe99da9c"
server_key_iv: "474db41342e76d88922893aa5bf952ea"
server_key_version: "encryptionkey@0"
I20260928 20:18:05.178401 8849 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:05.189721 8849 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:05.192232 8849 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:05.192381 8849 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:05.192613 8849 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:05.193053 8891 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 20:18:05.195266 8849 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 20:18:05.195333 8849 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260928 20:18:05.195377 8849 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 20:18:05.196010 8849 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 20:18:05.196066 8849 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:05.196144 8891 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Bootstrap starting.
I20260928 20:18:05.203042 8849 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:46625
I20260928 20:18:05.203425 8849 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:05.206459 8998 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:46625 every 8 connection(s)
I20260928 20:18:05.208091 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 8849
I20260928 20:18:05.208477 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:33995
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:43023
--webserver_port=36221
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:18:05.209970 8891 log.cc:824] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Log is configured to *not* fsync() on all Append() calls
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:05.213297 8891 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:18:05.213672 8891 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Bootstrap complete.
I20260928 20:18:05.215054 8891 ts_tablet_manager.cc:1397] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Time spent bootstrapping tablet: real 0.019s user 0.005s sys 0.010s
I20260928 20:18:05.216609 8891 raft_consensus.cc:348] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:18:05.216989 8891 raft_consensus.cc:729] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3811cbac8f4461bb074392178cf1847, State: Initialized, Role: FOLLOWER
I20260928 20:18:05.217180 8891 consensus_queue.cc:260] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:18:05.217485 8891 ts_tablet_manager.cc:1428] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Time spent starting tablet: real 0.002s user 0.001s sys 0.002s
I20260928 20:18:05.218139 9001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.204240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:56597)
0928 20:18:05.204471 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.204519 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.204963 (+ 444us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.207115 (+ 2152us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.207119 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.207413 (+ 294us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:05.207594 (+ 181us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.207599 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.209105 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.209106 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.210605 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.210609 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.211538 (+ 929us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.211540 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.211671 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.212229 (+ 558us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:05.212244 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:05.213632 (+ 1388us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:05.215790 (+ 2158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.215797 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.215798 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.216108 (+ 310us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.216416 (+ 308us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.216417 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.216417 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.216547 (+ 130us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.217250 (+ 703us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:05.217323 (+ 73us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:05.217502 (+ 179us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.217678 (+ 176us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.217874 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":128,"threads_started":1}
I20260928 20:18:05.218196 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.204356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:56597 (local address 127.24.190.62:43023)
0928 20:18:05.206710 (+ 2354us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.206719 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.206770 (+ 51us) server_negotiation.cc:407] Connection header received
0928 20:18:05.206890 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.206895 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.206936 (+ 41us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.207088 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:05.207818 (+ 730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.208977 (+ 1159us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.210727 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.211397 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.211530 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.213798 (+ 2268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:05.213802 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:05.213802 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:05.213814 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:05.215682 (+ 1868us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.216211 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.216214 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.216215 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.216345 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.216614 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.216615 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.216616 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.216916 (+ 300us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:05.217127 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.217807 (+ 680us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.217969 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2298,"thread_start_us":100,"threads_started":1}
I20260928 20:18:05.219751 8999 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43023
I20260928 20:18:05.219862 8999 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:05.220084 8999 heartbeater.cc:511] Master 127.24.190.62:43023 requested a full tablet report, sending...
I20260928 20:18:05.220966 8811 ts_manager.cc:194] Registered new tserver with Master: c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625)
I20260928 20:18:05.222232 8811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:56597
I20260928 20:18:05.223481 8999 heartbeater.cc:503] Master 127.24.190.62:43023 was elected leader, sending a full tablet report...
I20260928 20:18:05.231220 9007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.222374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46234 (local address 127.24.190.1:46625)
0928 20:18:05.226671 (+ 4297us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.226676 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.226685 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:05.226718 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.226720 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.226734 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.226798 (+ 64us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:05.227010 (+ 212us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.228214 (+ 1204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.229772 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.230767 (+ 995us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.230850 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.230904 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.231105 (+ 201us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.231145 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4266,"thread_start_us":75,"threads_started":1}
I20260928 20:18:05.231238 9006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.221669 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46625 (local address 127.0.0.1:46234)
0928 20:18:05.226433 (+ 4764us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.226477 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.226547 (+ 70us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.226858 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.226861 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.226863 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:05.226948 (+ 85us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.226950 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.228323 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.228325 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.229678 (+ 1353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.229681 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.230883 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.230885 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.230985 (+ 100us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.231000 (+ 15us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.231078 (+ 78us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.231132 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4728,"thread_start_us":92,"threads_started":1}
I20260928 20:18:05.231880 8932 tablet_service.cc:1514] Processing DeleteTablet for tablet 044251649ce44a688f062468757aed8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:44 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:46234
I20260928 20:18:05.232496 9008 tablet_replica.cc:330] stopping tablet replica
I20260928 20:18:05.232609 9008 raft_consensus.cc:2229] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:05.232677 9008 raft_consensus.cc:2258] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:05.233004 9008 ts_tablet_manager.cc:1905] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:05.235603 9008 ts_tablet_manager.cc:1918] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:05.235682 9008 log.cc:1196] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal/wals/044251649ce44a688f062468757aed8b
I20260928 20:18:05.235917 9008 ts_tablet_manager.cc:1939] T 044251649ce44a688f062468757aed8b P c3811cbac8f4461bb074392178cf1847: Deleting consensus metadata
I20260928 20:18:05.236534 8796 catalog_manager.cc:4841] TS c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625): tablet 044251649ce44a688f062468757aed8b (table test-table [id=2094465cd870435d8218844201b1df2c]) successfully deleted
W20260928 20:18:05.301491 9003 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:05.301707 9003 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:05.301731 9003 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:05.302934 9003 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:05.302978 9003 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:05.303006 9003 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:05.304453 9003 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:33995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=36221
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9003
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:05.304687 9003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:05.304908 9003 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:05.310340 9016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.310361 9014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.310259 9013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:05.310482 9003 server_base.cc:1034] running on GCE node
I20260928 20:18:05.310726 9003 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:05.311014 9003 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:05.312198 9003 hybrid_clock.cc:648] HybridClock initialized: now 1790626685312178 us; error 48 us; skew 500 ppm
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:05.314781 9003 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:18:05.315303 9003 webserver.cc:460] Webserver started at http://127.24.190.2:36221/ using document root <none> and password file <none>
I20260928 20:18:05.315546 9003 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:05.315627 9003 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:05.317039 9003 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:05.317791 9023 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.317979 9003 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:18:05.318079 9003 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "9c7e28faf2374c9e9986f451d14b5240"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "dc2735e7db1f44150da69d39d5345ac4"
server_key_iv: "25cb6d74a96686a4572264034d2588f1"
server_key_version: "encryptionkey@0"
I20260928 20:18:05.318557 9003 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:05.328457 9003 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:05.330614 9003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:05.330786 9003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:05.331043 9003 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:05.331475 9030 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 20:18:05.332912 9003 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 20:18:05.332988 9003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260928 20:18:05.333089 9003 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 20:18:05.333786 9003 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 20:18:05.333853 9003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:05.333925 9030 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Bootstrap starting.
I20260928 20:18:05.341035 9003 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:33995
I20260928 20:18:05.341094 9137 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:33995 every 8 connection(s)
I20260928 20:18:05.341439 9003 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:18:05.344873 9030 log.cc:824] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:05.347470 9030 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:18:05.347800 9030 tablet_bootstrap.cc:492] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Bootstrap complete.
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:05.348711 9030 ts_tablet_manager.cc:1397] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Time spent bootstrapping tablet: real 0.015s user 0.008s sys 0.004s
I20260928 20:18:05.349231 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9003
I20260928 20:18:05.349543 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:35367
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:43023
--webserver_port=46475
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:18:05.350116 9030 raft_consensus.cc:348] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:18:05.350519 9030 raft_consensus.cc:729] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c7e28faf2374c9e9986f451d14b5240, State: Initialized, Role: FOLLOWER
I20260928 20:18:05.350670 9030 consensus_queue.cc:260] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } }
I20260928 20:18:05.350989 9030 ts_tablet_manager.cc:1428] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Time spent starting tablet: real 0.002s user 0.002s sys 0.003s
I20260928 20:18:05.352723 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.342245 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:60909 (local address 127.24.190.62:43023)
0928 20:18:05.342326 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.342329 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.342668 (+ 339us) server_negotiation.cc:407] Connection header received
0928 20:18:05.343412 (+ 744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.343413 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.343425 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.343485 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:05.344504 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.345099 (+ 595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.346215 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.346539 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.346623 (+ 84us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.349123 (+ 2500us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:05.349124 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:05.349124 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:05.349134 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:05.351028 (+ 1894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.351584 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.351585 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.351586 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.351640 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.351994 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.351995 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.351995 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.352124 (+ 129us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:05.352190 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.352566 (+ 376us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.352654 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260928 20:18:05.352941 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.342149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:60909)
0928 20:18:05.342439 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.342501 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.343265 (+ 764us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.343571 (+ 306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.343578 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.344052 (+ 474us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:05.344388 (+ 336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.344396 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.345229 (+ 833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.345230 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.346113 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.346116 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.346645 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.346647 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.346808 (+ 161us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.347425 (+ 617us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:05.347434 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:05.349005 (+ 1571us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:05.351147 (+ 2142us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.351153 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.351156 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.351500 (+ 344us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.351753 (+ 253us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.351754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.351755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.351900 (+ 145us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.352217 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:05.352223 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:05.352387 (+ 164us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.352506 (+ 119us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.352685 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":195,"mutex_wait_us":4,"thread_start_us":130,"threads_started":1}
I20260928 20:18:05.353403 9138 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43023
I20260928 20:18:05.353543 9138 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:05.353811 9138 heartbeater.cc:511] Master 127.24.190.62:43023 requested a full tablet report, sending...
I20260928 20:18:05.354480 8811 ts_manager.cc:194] Registered new tserver with Master: 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
I20260928 20:18:05.355165 8811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:60909
I20260928 20:18:05.356247 9138 heartbeater.cc:503] Master 127.24.190.62:43023 was elected leader, sending a full tablet report...
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.2@KRBTEST.COM
I20260928 20:18:05.363746 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.355325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40600 (local address 127.24.190.2:33995)
0928 20:18:05.355488 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.355492 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.355501 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:05.355528 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.355530 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.355544 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.355610 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:05.356078 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.356903 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.357589 (+ 686us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.357885 (+ 296us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.357965 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.360475 (+ 2510us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:05.360483 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:05.360483 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:05.360497 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:05.362485 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.362885 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.362888 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.362889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.362949 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.363155 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.363156 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.363157 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.363305 (+ 148us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:05.363398 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.363564 (+ 166us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.363651 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":130,"thread_start_us":89,"threads_started":1}
I20260928 20:18:05.363746 9006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.354831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33995 (local address 127.0.0.1:40600)
0928 20:18:05.354890 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.354899 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.354947 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.355673 (+ 726us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.355675 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.355957 (+ 282us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:05.355992 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.355993 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.356992 (+ 999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.356994 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.357489 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.357490 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.357964 (+ 474us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.357965 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.358020 (+ 55us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.358666 (+ 646us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:05.358670 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:05.360365 (+ 1695us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:05.362567 (+ 2202us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.362576 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.362578 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.362786 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.363024 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.363025 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.363025 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.363089 (+ 64us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.363377 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:05.363385 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:05.363438 (+ 53us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.363530 (+ 92us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.363647 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 20:18:05.364220 9072 tablet_service.cc:1514] Processing DeleteTablet for tablet 044251649ce44a688f062468757aed8b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:17:44 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:40600
I20260928 20:18:05.364744 9145 tablet_replica.cc:330] stopping tablet replica
I20260928 20:18:05.364871 9145 raft_consensus.cc:2229] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:05.364946 9145 raft_consensus.cc:2258] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:05.365259 9145 ts_tablet_manager.cc:1905] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:05.367805 9145 ts_tablet_manager.cc:1918] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:05.367882 9145 log.cc:1196] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/044251649ce44a688f062468757aed8b
I20260928 20:18:05.368103 9145 ts_tablet_manager.cc:1939] T 044251649ce44a688f062468757aed8b P 9c7e28faf2374c9e9986f451d14b5240: Deleting consensus metadata
I20260928 20:18:05.368603 8796 catalog_manager.cc:4841] TS 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): tablet 044251649ce44a688f062468757aed8b (table test-table [id=2094465cd870435d8218844201b1df2c]) successfully deleted
W20260928 20:18:05.436079 9143 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:05.436291 9143 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:05.436316 9143 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:05.437505 9143 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:05.437548 9143 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:05.437575 9143 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:05.439214 9143 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:35367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=46475
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9143
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:05.439471 9143 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:05.439719 9143 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:05.445192 9153 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.445278 9151 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:05.445148 9150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:05.445214 9143 server_base.cc:1034] running on GCE node
I20260928 20:18:05.445521 9143 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:05.445717 9143 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:05.446852 9143 hybrid_clock.cc:648] HybridClock initialized: now 1790626685446843 us; error 33 us; skew 500 ppm
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:05.449293 9143 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:18:05.449766 9143 webserver.cc:460] Webserver started at http://127.24.190.3:46475/ using document root <none> and password file <none>
I20260928 20:18:05.450004 9143 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:05.450088 9143 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:05.451493 9143 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:05.452114 9160 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.452351 9143 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:05.452451 9143 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "13c163ccd4b04d0794b2bf998eb1785c"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "eab9f214ec675c0fce2d207b39a333e5"
server_key_iv: "2d87b11040bf5b84167d54b88523df19"
server_key_version: "encryptionkey@0"
I20260928 20:18:05.452800 9143 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:05.483440 9143 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:05.485844 9143 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:05.486009 9143 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:05.486253 9143 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:05.486596 9143 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:05.486651 9143 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.486687 9143 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:05.486717 9143 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.492530 9143 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:35367
I20260928 20:18:05.492580 9273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:35367 every 8 connection(s)
I20260928 20:18:05.492954 9143 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:18:05.496126 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9143
Sep 28 20:18:05 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626685, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:05.504158 9002 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.493837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:36251 (local address 127.24.190.62:43023)
0928 20:18:05.493905 (+ 68us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.493907 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.494186 (+ 279us) server_negotiation.cc:407] Connection header received
0928 20:18:05.494576 (+ 390us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.494577 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.494590 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.494655 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:05.495549 (+ 894us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.496054 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.497720 (+ 1666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.498001 (+ 281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.498072 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.500680 (+ 2608us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:05.500681 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:05.500681 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:05.500688 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:05.502717 (+ 2029us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.503100 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.503102 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.503102 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.503169 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.503442 (+ 273us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.503443 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.503443 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.503571 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:05.503665 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.503965 (+ 300us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.504055 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:18:05.504329 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.496581 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57468 (local address 127.24.190.62:43023)
0928 20:18:05.496688 (+ 107us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.496690 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.496802 (+ 112us) server_negotiation.cc:407] Connection header received
0928 20:18:05.496862 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.496863 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.496872 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.496924 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:05.497627 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.498451 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.499537 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.499838 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.499909 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.501229 (+ 1320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:05.501231 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:05.501231 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:05.501238 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:05.503044 (+ 1806us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.503461 (+ 417us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.503463 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.503463 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.503534 (+ 71us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.503783 (+ 249us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.503784 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.503784 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.503902 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:05.504079 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.504117 (+ 38us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.504210 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88,"thread_start_us":55,"threads_started":1}
I20260928 20:18:05.504833 9276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.493824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:36251)
0928 20:18:05.493974 (+ 150us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.494008 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.494481 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.494711 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.494714 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.495271 (+ 557us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:05.495457 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.495461 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.496286 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.496288 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.497632 (+ 1344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.497635 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.498084 (+ 449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.498085 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.498314 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.498818 (+ 504us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:05.498828 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:05.500577 (+ 1749us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:05.502801 (+ 2224us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.502807 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.502808 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.503022 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.503230 (+ 208us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:05.503231 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:05.503231 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:05.503354 (+ 123us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:05.503654 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:05.503660 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:05.503815 (+ 155us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.503941 (+ 126us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.504129 (+ 188us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":115,"thread_start_us":87,"threads_started":1}
I20260928 20:18:05.505334 9274 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43023
I20260928 20:18:05.505456 9274 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:05.505654 9274 heartbeater.cc:511] Master 127.24.190.62:43023 requested a full tablet report, sending...
I20260928 20:18:05.506103 8811 ts_manager.cc:194] Registered new tserver with Master: 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367)
I20260928 20:18:05.506629 8811 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:36251
I20260928 20:18:05.516535 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:05.520155 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.517029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57476 (local address 127.24.190.62:43023)
0928 20:18:05.517100 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.517103 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.517237 (+ 134us) server_negotiation.cc:407] Connection header received
0928 20:18:05.517342 (+ 105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.517343 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.517394 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.517472 (+ 78us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:05.517626 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.518119 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.519037 (+ 918us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.519429 (+ 392us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.519667 (+ 238us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.519720 (+ 53us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:05.519776 (+ 56us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0928 20:18:05.520082 (+ 306us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:57476: token expired
Metrics: {"server-negotiator.queue_time_us":44}
W20260928 20:18:05.520308 9278 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:57476: token expired
W20260928 20:18:05.520641 8740 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.24.190.62:43023)
I20260928 20:18:05.527423 9278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.520900 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57490 (local address 127.24.190.62:43023)
0928 20:18:05.520965 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.520967 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.520975 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:18:05.520996 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.520997 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.521006 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.521081 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:05.521616 (+ 535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.522081 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.522971 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.523178 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.523236 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.524604 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:05.524605 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:05.524606 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:05.524620 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:05.525909 (+ 1289us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.526361 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.526363 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.526363 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.526427 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:05.526837 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:05.526839 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:05.526839 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:05.526967 (+ 128us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:05.527081 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.527196 (+ 115us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.527325 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 20:18:05.528704 8811 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57490:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:05.530395 8811 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:05.532614 8932 tablet_service.cc:1467] Processing CreateTablet for tablet 59d8a690843f4b5db6cf0d8988688a5b (DEFAULT_TABLE table=test-table [id=27f7b60e8f0a4616a4e64459140b6ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:05.532639 9072 tablet_service.cc:1467] Processing CreateTablet for tablet 59d8a690843f4b5db6cf0d8988688a5b (DEFAULT_TABLE table=test-table [id=27f7b60e8f0a4616a4e64459140b6ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:05.532810 8932 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d8a690843f4b5db6cf0d8988688a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:05.532876 9072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d8a690843f4b5db6cf0d8988688a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:05.534128 8891 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Bootstrap starting.
I20260928 20:18:05.534461 9030 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Bootstrap starting.
I20260928 20:18:05.534583 8891 tablet_bootstrap.cc:654] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:05.534783 9030 tablet_bootstrap.cc:654] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:05.535106 8891 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: No bootstrap required, opened a new log
I20260928 20:18:05.535151 8891 ts_tablet_manager.cc:1397] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:05.535284 9030 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: No bootstrap required, opened a new log
I20260928 20:18:05.535257 8891 raft_consensus.cc:348] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.535320 9030 ts_tablet_manager.cc:1397] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Time spent bootstrapping tablet: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:05.535326 8891 raft_consensus.cc:374] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:05.535377 8891 raft_consensus.cc:729] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3811cbac8f4461bb074392178cf1847, State: Initialized, Role: FOLLOWER
I20260928 20:18:05.535435 8891 consensus_queue.cc:260] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.535526 8891 ts_tablet_manager.cc:1428] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Time spent starting tablet: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:05.535665 9030 raft_consensus.cc:348] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.535740 9030 raft_consensus.cc:374] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:05.535782 9030 raft_consensus.cc:729] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c7e28faf2374c9e9986f451d14b5240, State: Initialized, Role: FOLLOWER
I20260928 20:18:05.535827 9030 consensus_queue.cc:260] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.535904 9030 ts_tablet_manager.cc:1428] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:05.537794 9006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.532432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:35367 (local address 127.0.0.1:36126)
0928 20:18:05.532516 (+ 84us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.532527 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.532563 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.534623 (+ 2060us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.534624 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.534626 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:05.534690 (+ 64us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.534692 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.535887 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.535888 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.536837 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.536839 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.537544 (+ 705us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.537545 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.537607 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.537612 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.537679 (+ 67us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.537723 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":66}
I20260928 20:18:05.537803 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.534239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36126 (local address 127.24.190.3:35367)
0928 20:18:05.534445 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.534450 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.534459 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:05.534491 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.534493 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.534506 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.534629 (+ 123us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:05.534749 (+ 120us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.535791 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.536926 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.537454 (+ 528us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.537545 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.537609 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.537693 (+ 84us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.537728 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":173,"thread_start_us":132,"threads_started":1}
I20260928 20:18:05.538579 9208 tablet_service.cc:1467] Processing CreateTablet for tablet 59d8a690843f4b5db6cf0d8988688a5b (DEFAULT_TABLE table=test-table [id=27f7b60e8f0a4616a4e64459140b6ac5]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:05.538901 9208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59d8a690843f4b5db6cf0d8988688a5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:05.541570 9283 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Bootstrap starting.
I20260928 20:18:05.542339 9283 tablet_bootstrap.cc:654] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:05.542835 9283 log.cc:824] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:05.543514 9283 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: No bootstrap required, opened a new log
I20260928 20:18:05.543571 9283 ts_tablet_manager.cc:1397] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:18:05.544873 9283 raft_consensus.cc:348] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.545017 9283 raft_consensus.cc:374] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:05.545038 9283 raft_consensus.cc:729] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13c163ccd4b04d0794b2bf998eb1785c, State: Initialized, Role: FOLLOWER
I20260928 20:18:05.545164 9283 consensus_queue.cc:260] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.545456 9274 heartbeater.cc:503] Master 127.24.190.62:43023 was elected leader, sending a full tablet report...
I20260928 20:18:05.545457 9283 ts_tablet_manager.cc:1428] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
W20260928 20:18:05.592079 9139 tablet.cc:2369] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:05.691465 9142 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:05.691716 9142 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.692101 9142 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625)
I20260928 20:18:05.695390 9280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.692470 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38311 (local address 127.24.190.3:35367)
0928 20:18:05.692515 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.692517 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.692564 (+ 47us) server_negotiation.cc:407] Connection header received
0928 20:18:05.692640 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.692643 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.692656 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.692759 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:05.692936 (+ 177us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.693419 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.694611 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.694997 (+ 386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.695079 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.695088 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.695283 (+ 195us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.695316 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:18:05.695407 9007 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.692438 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:39035 (local address 127.24.190.1:46625)
0928 20:18:05.692488 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.692490 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.692502 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:18:05.692567 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.692568 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.692579 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.692694 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:05.692891 (+ 197us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.693433 (+ 542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.694607 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.695010 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.695108 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.695126 (+ 18us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.695285 (+ 159us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.695329 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":27}
I20260928 20:18:05.695415 9140 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.692315 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46625 (local address 127.24.190.2:39035)
0928 20:18:05.692375 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.692390 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.692472 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.692699 (+ 227us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.692700 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.692702 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:05.692788 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.692790 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.693530 (+ 740us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.693531 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.694504 (+ 973us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.694507 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.695108 (+ 601us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.695109 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.695199 (+ 90us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.695202 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.695279 (+ 77us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.695321 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33,"mutex_wait_us":21}
I20260928 20:18:05.695710 9286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.692330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:35367 (local address 127.24.190.2:38311)
0928 20:18:05.692498 (+ 168us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.692510 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:05.692576 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:05.692764 (+ 188us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:05.692765 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:05.692767 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:05.692857 (+ 90us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.692859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.693516 (+ 657us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.693518 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.694523 (+ 1005us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:05.694525 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.695107 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.695109 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:05.695177 (+ 68us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.695194 (+ 17us) client_negotiation.cc:769] Sending connection context
0928 20:18:05.695263 (+ 69us) client_negotiation.cc:240] Negotiation successful
0928 20:18:05.695305 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"mutex_wait_us":52,"thread_start_us":96,"threads_started":1}
I20260928 20:18:05.695806 8953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d8a690843f4b5db6cf0d8988688a5b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3811cbac8f4461bb074392178cf1847" is_pre_election: true
I20260928 20:18:05.696038 8953 raft_consensus.cc:2454] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 0.
I20260928 20:18:05.696071 9228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d8a690843f4b5db6cf0d8988688a5b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13c163ccd4b04d0794b2bf998eb1785c" is_pre_election: true
I20260928 20:18:05.696230 9228 raft_consensus.cc:2454] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 0.
I20260928 20:18:05.696283 9025 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9c7e28faf2374c9e9986f451d14b5240, c3811cbac8f4461bb074392178cf1847; no voters:
I20260928 20:18:05.696439 9142 raft_consensus.cc:2781] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:05.696494 9142 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:05.696511 9142 raft_consensus.cc:3037] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:05.697392 9142 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.697536 9142 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 election: Requested vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625)
I20260928 20:18:05.697702 8953 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d8a690843f4b5db6cf0d8988688a5b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3811cbac8f4461bb074392178cf1847"
I20260928 20:18:05.697770 9228 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59d8a690843f4b5db6cf0d8988688a5b" candidate_uuid: "9c7e28faf2374c9e9986f451d14b5240" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "13c163ccd4b04d0794b2bf998eb1785c"
I20260928 20:18:05.697824 8953 raft_consensus.cc:3037] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:05.697854 9228 raft_consensus.cc:3037] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:05.699015 9228 raft_consensus.cc:2454] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 1.
I20260928 20:18:05.699225 9024 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 13c163ccd4b04d0794b2bf998eb1785c, 9c7e28faf2374c9e9986f451d14b5240; no voters:
I20260928 20:18:05.699332 9142 raft_consensus.cc:2781] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:05.699332 8953 raft_consensus.cc:2454] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9c7e28faf2374c9e9986f451d14b5240 in term 1.
I20260928 20:18:05.699525 9142 raft_consensus.cc:686] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 LEADER]: Becoming Leader. State: Replica: 9c7e28faf2374c9e9986f451d14b5240, State: Running, Role: LEADER
I20260928 20:18:05.699609 9142 consensus_queue.cc:237] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:05.700532 8810 catalog_manager.cc:5495] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "9c7e28faf2374c9e9986f451d14b5240" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } health_report { overall_health: HEALTHY } } }
W20260928 20:18:05.707037 9000 tablet.cc:2369] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:05.719810 9144 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.716829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40616 (local address 127.24.190.2:33995)
0928 20:18:05.716929 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:05.716931 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:05.716967 (+ 36us) server_negotiation.cc:407] Connection header received
0928 20:18:05.717096 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:05.717097 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:05.717117 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:05.717199 (+ 82us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:05.717336 (+ 137us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.717837 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.718771 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:05.718981 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:05.719093 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:05.719426 (+ 333us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:05.719538 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:05.719623 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:05.719683 (+ 60us) server_negotiation.cc:299] Negotiation successful
0928 20:18:05.719707 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260928 20:18:05.721624 9228 raft_consensus.cc:1261] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Refusing update from remote peer 9c7e28faf2374c9e9986f451d14b5240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:05.721626 8953 raft_consensus.cc:1261] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Refusing update from remote peer 9c7e28faf2374c9e9986f451d14b5240: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:05.722059 9287 consensus_queue.cc:1035] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:05.722292 9142 consensus_queue.cc:1035] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:05.724649 9292 mvcc.cc:205] Tried to move back new op lower bound from 7334406904712597504 to 7334406904626278400. Current Snapshot: MvccSnapshot[applied={T|T < 7334406904712597504}]
I20260928 20:18:05.725371 9290 mvcc.cc:205] Tried to move back new op lower bound from 7334406904712597504 to 7334406904626278400. Current Snapshot: MvccSnapshot[applied={T|T < 7334406904712597504 or (T in {7334406904712597504})}]
I20260928 20:18:05.726437 8811 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:05.726528 8811 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57490:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:05.727396 8811 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Sending DeleteTablet for 3 replicas of tablet 59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:05.727741 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8849
I20260928 20:18:05.727732 9072 tablet_service.cc:1514] Processing DeleteTablet for tablet 59d8a690843f4b5db6cf0d8988688a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:05 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:40600
I20260928 20:18:05.727757 9208 tablet_service.cc:1514] Processing DeleteTablet for tablet 59d8a690843f4b5db6cf0d8988688a5b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:05 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:36126
I20260928 20:18:05.727818 9145 tablet_replica.cc:330] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: stopping tablet replica
I20260928 20:18:05.727866 9145 raft_consensus.cc:2229] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:18:05.728382 9298 tablet_replica.cc:330] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: stopping tablet replica
I20260928 20:18:05.728475 9298 raft_consensus.cc:2229] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:05.728571 9298 raft_consensus.cc:2258] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:05.729218 9145 raft_consensus.cc:2258] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:05.729599 9145 ts_tablet_manager.cc:1905] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:05.729676 9298 ts_tablet_manager.cc:1905] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:05.731485 9145 ts_tablet_manager.cc:1918] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:05.731487 9298 ts_tablet_manager.cc:1918] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:05.731546 9145 log.cc:1196] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:05.731555 9298 log.cc:1196] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:05.731796 9145 ts_tablet_manager.cc:1939] T 59d8a690843f4b5db6cf0d8988688a5b P 9c7e28faf2374c9e9986f451d14b5240: Deleting consensus metadata
I20260928 20:18:05.731817 9298 ts_tablet_manager.cc:1939] T 59d8a690843f4b5db6cf0d8988688a5b P 13c163ccd4b04d0794b2bf998eb1785c: Deleting consensus metadata
I20260928 20:18:05.732124 8796 catalog_manager.cc:4841] TS 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): tablet 59d8a690843f4b5db6cf0d8988688a5b (table test-table [id=27f7b60e8f0a4616a4e64459140b6ac5]) successfully deleted
I20260928 20:18:05.732290 8795 catalog_manager.cc:4841] TS 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): tablet 59d8a690843f4b5db6cf0d8988688a5b (table test-table [id=27f7b60e8f0a4616a4e64459140b6ac5]) successfully deleted
W20260928 20:18:05.734120 8796 connection.cc:535] client connection to 127.24.190.1:46625 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 20:18:05.734215 8796 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 20:18:05.734655 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9003
I20260928 20:18:05.734721 9006 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:05.734544 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46625 (local address 127.0.0.1:46242)
0928 20:18:05.734614 (+ 70us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:05.734668 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:46625: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260928 20:18:05.735419 8796 catalog_manager.cc:4584] TS c3811cbac8f4461bb074392178cf1847 (127.24.190.1:46625): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 59d8a690843f4b5db6cf0d8988688a5b: Network error: Client connection negotiation failed: client connection to 127.24.190.1:46625: connect: Connection refused (error 111)
I20260928 20:18:05.741041 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9143
I20260928 20:18:05.745777 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 8778
I20260928 20:18:25.751470 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43023
--webserver_interface=127.24.190.62
--webserver_port=35055
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43023
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:25.832139 9300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:25.832369 9300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:25.832392 9300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:25.833557 9300 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260928 20:18:25.833598 9300 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260928 20:18:25.833612 9300 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260928 20:18:25.833623 9300 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:25.833663 9300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:25.833693 9300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:25.833710 9300 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:25.833736 9300 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:25.835259 9300 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43023
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43023
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=35055
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9300
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:25.835512 9300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:25.835737 9300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:25.840776 9305 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:25.840809 9306 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:25.840793 9308 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:25.841086 9300 server_base.cc:1034] running on GCE node
I20260928 20:18:25.841374 9300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:25.841689 9300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:25.842896 9300 hybrid_clock.cc:648] HybridClock initialized: now 1790626705842875 us; error 38 us; skew 500 ppm
Sep 28 20:18:25 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626705, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:25.845657 9300 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:18:25.846354 9300 webserver.cc:460] Webserver started at http://127.24.190.62:35055/ using document root <none> and password file <none>
I20260928 20:18:25.846587 9300 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:25.846657 9300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:25.848068 9300 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:25.850001 9315 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:25.850194 9300 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:25.850325 9300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a"
format_stamp: "Formatted at 2026-09-28 20:17:43 on dist-test-slave-n45k"
server_key: "8eb274d0d4398bfbb7658f304e3fb93e"
server_key_iv: "170036e444d58d4660185a27c7e44072"
server_key_version: "encryptionkey@0"
I20260928 20:18:25.850699 9300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:25.866370 9300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:25.868373 9300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:25.868544 9300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:25.872839 9300 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43023
I20260928 20:18:25.872900 9367 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43023 every 8 connection(s)
I20260928 20:18:25.873298 9300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:25.874918 9368 sys_catalog.cc:263] Verifying existing consensus state
I20260928 20:18:25.875591 9368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap starting.
I20260928 20:18:25.876600 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9300
I20260928 20:18:25.876891 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:46625
--local_ip_for_outbound_sockets=127.24.190.1
--tserver_master_addrs=127.24.190.62:43023
--webserver_port=35299
--webserver_interface=127.24.190.1
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:18:25.884312 9368 log.cc:824] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:25.886842 9368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:18:25.887162 9368 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Bootstrap complete.
I20260928 20:18:25.889379 9368 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:25.889597 9368 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7995b2e7dafc4e1da9212fc7d4e43b3a, State: Initialized, Role: FOLLOWER
I20260928 20:18:25.889777 9368 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:25.889838 9368 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:25.889904 9368 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:25.889950 9368 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 2 FOLLOWER]: Advancing to term 3
I20260928 20:18:25.891062 9368 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:25.891151 9368 leader_election.cc:302] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7995b2e7dafc4e1da9212fc7d4e43b3a; no voters:
I20260928 20:18:25.891390 9368 leader_election.cc:288] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260928 20:18:25.891425 9372 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 3 FOLLOWER]: Leader election won for term 3
I20260928 20:18:25.891539 9372 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [term 3 LEADER]: Becoming Leader. State: Replica: 7995b2e7dafc4e1da9212fc7d4e43b3a, State: Running, Role: LEADER
I20260928 20:18:25.891628 9372 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } }
I20260928 20:18:25.891665 9368 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:25.891887 9372 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7995b2e7dafc4e1da9212fc7d4e43b3a. Latest consensus state: current_term: 3 leader_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } } }
I20260928 20:18:25.891966 9372 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:25.891892 9373 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7995b2e7dafc4e1da9212fc7d4e43b3a" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43023 } } }
I20260928 20:18:25.892129 9373 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:25.892158 9376 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:25.893016 9376 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:25.893131 9376 catalog_manager.cc:1259] Loaded cluster ID: 3da036192a394c628a7ded7f384dc0b2
I20260928 20:18:25.893173 9376 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:25.894148 9376 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:25.894367 9376 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Loaded TSK: 0
I20260928 20:18:25.894430 9376 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7995b2e7dafc4e1da9212fc7d4e43b3a: Loaded TSK: 1
F20260928 20:18:25.894631 9376 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fe25e5b89ad google::LogMessage::Fail() at ??:0
@ 0x7fe25e5bb88a google::LogMessage::SendToLog() at ??:0
@ 0x7fe25e5b84de google::LogMessage::Flush() at ??:0
@ 0x7fe25e5b9a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fe260d25104 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fe260d22d41 kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fe2665161cd kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fe26651648e kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fe266516594 _ZNSt17_Function_handlerIFN4kudu6StatusEvEZNS0_6master14CatalogManager24PrepareForLeadershipTaskEvEUlvE3_E9_M_invokeERKSt9_Any_data at ??:0
@ 0x7fe2664dcc48 _ZZN4kudu6master14CatalogManager24PrepareForLeadershipTaskEvENKUlSt8functionIFNS_6StatusEvEERKNS_9consensus13RaftConsensusElPKcE_clES5_S9_lSB_.isra.591 at ??:0
@ 0x7fe2664e6ad0 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fe2604860d3 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fe26047b954 kudu::Thread::SuperviseThread() at ??:0
@ 0x7fe2612df6db start_thread at ??:0
@ 0x7fe25d0b661f clone at ??:0
W20260928 20:18:25.974478 9370 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:25.974727 9370 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:25.974766 9370 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:25.975934 9370 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:25.976006 9370 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:25.976051 9370 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:25.977550 9370 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:46625
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=35299
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9370
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:25.977829 9370 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:25.978072 9370 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:25.983367 9410 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:25.983409 9370 server_base.cc:1034] running on GCE node
W20260928 20:18:25.983596 9412 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:25.983732 9409 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:25.983985 9370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:25.984221 9370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:25.985394 9370 hybrid_clock.cc:648] HybridClock initialized: now 1790626705985380 us; error 30 us; skew 500 ppm
Sep 28 20:18:25 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626705, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:25.988263 9370 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:18:25.988807 9370 webserver.cc:460] Webserver started at http://127.24.190.1:35299/ using document root <none> and password file <none>
I20260928 20:18:25.989081 9370 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:25.989153 9370 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:25.990929 9370 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:18:25.991714 9419 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:25.991917 9370 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:25.992012 9370 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "c3811cbac8f4461bb074392178cf1847"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "1a7e6307bcff61da057905e9fe99da9c"
server_key_iv: "474db41342e76d88922893aa5bf952ea"
server_key_version: "encryptionkey@0"
I20260928 20:18:25.992444 9370 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:26.016584 9370 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:26.019546 9370 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:26.019713 9370 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:26.020028 9370 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:26.020561 9426 ts_tablet_manager.cc:536] Loading tablet metadata (0/1 complete)
I20260928 20:18:26.022081 9370 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260928 20:18:26.022145 9370 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.002s user 0.000s sys 0.000s
I20260928 20:18:26.022182 9370 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260928 20:18:26.023087 9370 ts_tablet_manager.cc:610] Registered 1 tablets
I20260928 20:18:26.023135 9370 ts_tablet_manager.cc:589] Time spent register tablets: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:26.023294 9426 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Bootstrap starting.
I20260928 20:18:26.030757 9370 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:46625
I20260928 20:18:26.031002 9533 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:46625 every 8 connection(s)
I20260928 20:18:26.031224 9370 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:26.032371 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9370
I20260928 20:18:26.032711 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:33995
--local_ip_for_outbound_sockets=127.24.190.2
--tserver_master_addrs=127.24.190.62:43023
--webserver_port=36221
--webserver_interface=127.24.190.2
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:18:26.034086 9426 log.cc:824] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:26.036437 9426 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260928 20:18:26.036762 9426 tablet_bootstrap.cc:492] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Bootstrap complete.
I20260928 20:18:26.037925 9426 ts_tablet_manager.cc:1397] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Time spent bootstrapping tablet: real 0.015s user 0.006s sys 0.007s
I20260928 20:18:26.039798 9426 raft_consensus.cc:348] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:26.040232 9426 raft_consensus.cc:729] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3811cbac8f4461bb074392178cf1847, State: Initialized, Role: FOLLOWER
I20260928 20:18:26.040416 9426 consensus_queue.cc:260] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:26.040716 9426 ts_tablet_manager.cc:1428] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
W20260928 20:18:26.101153 9536 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:18:26.031980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:52213)
0928 20:18:26.034371 (+ 2391us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.034423 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:26.035106 (+ 683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:26.100932 (+ 65826us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":169,"thread_start_us":97,"threads_started":1}
W20260928 20:18:26.101439 9534 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:43023 (0 consecutive failures): Network error: Failed to ping master at 127.24.190.62:43023: Client connection negotiation failed: client connection to 127.24.190.62:43023: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 20:18:26.101768 9536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.101648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:33439)
0928 20:18:26.101706 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.101743 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260928 20:18:26.102136 9536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.102050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:44673)
0928 20:18:26.102096 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.102120 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260928 20:18:26.102293 9534 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260928 20:18:26.117885 9537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:26.118100 9537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:26.118125 9537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:26.119304 9537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:26.119349 9537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:26.119376 9537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:26.120847 9537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:33995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=36221
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9537
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:26.121031 9537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:26.121210 9537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:26.126338 9544 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:26.126407 9537 server_base.cc:1034] running on GCE node
W20260928 20:18:26.126364 9545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:26.126364 9547 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:26.126760 9537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:26.126986 9537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:26.128229 9537 hybrid_clock.cc:648] HybridClock initialized: now 1790626706128214 us; error 38 us; skew 500 ppm
Sep 28 20:18:26 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626706, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:26.130817 9537 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:18:26.131192 9537 webserver.cc:460] Webserver started at http://127.24.190.2:36221/ using document root <none> and password file <none>
I20260928 20:18:26.131451 9537 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:26.131523 9537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:26.132853 9537 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:26.133455 9554 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:26.133634 9537 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:18:26.133741 9537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "9c7e28faf2374c9e9986f451d14b5240"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "dc2735e7db1f44150da69d39d5345ac4"
server_key_iv: "25cb6d74a96686a4572264034d2588f1"
server_key_version: "encryptionkey@0"
I20260928 20:18:26.134092 9537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:26.155906 9537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:26.158347 9537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:26.158514 9537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:26.158769 9537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:26.159085 9537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:26.159155 9537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:26.159197 9537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:26.159224 9537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:26.165110 9537 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:33995
I20260928 20:18:26.165158 9667 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:33995 every 8 connection(s)
I20260928 20:18:26.165511 9537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:18:26.166723 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.166209 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:53369)
0928 20:18:26.166424 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.166558 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":170,"thread_start_us":136,"threads_started":1}
W20260928 20:18:26.167255 9668 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:43023 (0 consecutive failures): Network error: Failed to ping master at 127.24.190.62:43023: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
I20260928 20:18:26.167543 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.167471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:43003)
0928 20:18:26.167499 (+ 28us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.167526 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":15}
I20260928 20:18:26.167826 9670 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.167743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:52965)
0928 20:18:26.167795 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.167814 (+ 19us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
W20260928 20:18:26.167940 9668 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 20:18:26.170349 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9537
I20260928 20:18:26.170643 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:35367
--local_ip_for_outbound_sockets=127.24.190.3
--tserver_master_addrs=127.24.190.62:43023
--webserver_port=46475
--webserver_interface=127.24.190.3
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37249
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:26.250914 9671 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:26.251154 9671 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:26.251178 9671 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:26.252345 9671 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:26.252388 9671 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:26.252414 9671 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:26.253923 9671 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37249
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:35367
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=46475
--tserver_master_addrs=127.24.190.62:43023
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9671
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:26.254170 9671 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:26.254431 9671 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:26.259518 9676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:26.259491 9677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:26.259487 9679 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:26.259759 9671 server_base.cc:1034] running on GCE node
I20260928 20:18:26.259981 9671 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:26.260345 9671 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:26.261533 9671 hybrid_clock.cc:648] HybridClock initialized: now 1790626706261517 us; error 60 us; skew 500 ppm
Sep 28 20:18:26 dist-test-slave-n45k krb5kdc[8232](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626706, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:26.264147 9671 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:18:26.264588 9671 webserver.cc:460] Webserver started at http://127.24.190.3:46475/ using document root <none> and password file <none>
I20260928 20:18:26.264787 9671 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:26.264830 9671 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:26.266201 9671 fs_manager.cc:709] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:26.266937 9686 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:26.267210 9671 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:26.267309 9671 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "13c163ccd4b04d0794b2bf998eb1785c"
format_stamp: "Formatted at 2026-09-28 20:17:44 on dist-test-slave-n45k"
server_key: "eab9f214ec675c0fce2d207b39a333e5"
server_key_iv: "2d87b11040bf5b84167d54b88523df19"
server_key_version: "encryptionkey@0"
I20260928 20:18:26.267661 9671 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:26.282815 9671 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:26.284904 9671 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:26.285030 9671 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:26.285239 9671 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:26.285599 9671 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:26.285640 9671 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:26.285665 9671 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:26.285678 9671 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:26.292063 9671 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:35367
I20260928 20:18:26.292142 9799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:35367 every 8 connection(s)
I20260928 20:18:26.292522 9671 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:18:26.293666 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.293292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:56593)
0928 20:18:26.293450 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.293523 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118,"thread_start_us":68,"threads_started":1}
W20260928 20:18:26.294096 9800 heartbeater.cc:644] Failed to heartbeat to 127.24.190.62:43023 (0 consecutive failures): Network error: Failed to ping master at 127.24.190.62:43023: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
I20260928 20:18:26.294482 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.294370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:38719)
0928 20:18:26.294416 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.294463 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
I20260928 20:18:26.294812 9802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:26.294728 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:47073)
0928 20:18:26.294777 (+ 49us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:26.294797 (+ 20us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260928 20:18:26.294940 9800 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260928 20:18:26.295665 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9671
I20260928 20:18:27.103031 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.102722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:55703)
0928 20:18:27.102886 (+ 164us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:27.102933 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":63,"threads_started":1}
I20260928 20:18:27.168573 9805 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.168242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:51249)
0928 20:18:27.168453 (+ 211us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:27.168484 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":196,"thread_start_us":131,"threads_started":1}
I20260928 20:18:27.295588 9806 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.295350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:33583)
0928 20:18:27.295490 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:27.295532 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":61,"threads_started":1}
I20260928 20:18:27.660557 9807 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:27.660676 9807 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:27.660959 9807 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
Sep 28 20:18:27 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626705, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.2@KRBTEST.COM
Sep 28 20:18:27 dist-test-slave-n45k krb5kdc[8232](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626705, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.3@KRBTEST.COM
I20260928 20:18:27.680220 9810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.661351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:57421 (local address 127.24.190.3:35367)
0928 20:18:27.661517 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:27.661527 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:27.661559 (+ 32us) server_negotiation.cc:407] Connection header received
0928 20:18:27.662010 (+ 451us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:27.662012 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:27.662050 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:27.662214 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:27.663058 (+ 844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.663889 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.664855 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.665287 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.665393 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:27.676685 (+ 11292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:27.676688 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:27.676689 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:27.676701 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:27.678413 (+ 1712us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:27.678896 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:27.678899 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:27.678899 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:27.678996 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:27.679265 (+ 269us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:27.679266 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:27.679267 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:27.679547 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:27.679650 (+ 103us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:27.679946 (+ 296us) server_negotiation.cc:299] Negotiation successful
0928 20:18:27.680094 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":121,"thread_start_us":56,"threads_started":1}
I20260928 20:18:27.680228 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.661134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:35367 (local address 127.24.190.1:57421)
0928 20:18:27.661405 (+ 271us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:27.661414 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:27.661459 (+ 45us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:27.662247 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:27.662250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:27.662734 (+ 484us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:27.662917 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:27.662923 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.663990 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.663991 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:27.664767 (+ 776us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:27.664770 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.665377 (+ 607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.665378 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:27.665486 (+ 108us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:27.674389 (+ 8903us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:27.674408 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:27.676557 (+ 2149us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:27.678511 (+ 1954us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:27.678512 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:27.678513 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:27.678807 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:27.679075 (+ 268us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:27.679076 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:27.679077 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:27.679188 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:27.679629 (+ 441us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:27.679636 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:27.679777 (+ 141us) client_negotiation.cc:769] Sending connection context
0928 20:18:27.679891 (+ 114us) client_negotiation.cc:240] Negotiation successful
0928 20:18:27.680093 (+ 202us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":257,"mutex_wait_us":16,"thread_start_us":73,"threads_started":1}
I20260928 20:18:27.680308 9811 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.661352 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:50095 (local address 127.24.190.2:33995)
0928 20:18:27.661519 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:27.661531 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:27.661567 (+ 36us) server_negotiation.cc:407] Connection header received
0928 20:18:27.662002 (+ 435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:27.662004 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:27.662047 (+ 43us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:27.662213 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:27.663041 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.663899 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.664912 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.665299 (+ 387us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.665424 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:27.676328 (+ 10904us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:27.676332 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:27.676333 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:27.676364 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:27.678384 (+ 2020us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:27.678893 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:27.678897 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:27.678898 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:27.678995 (+ 97us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:27.679257 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:27.679258 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:27.679258 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:27.679782 (+ 524us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:27.679877 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:27.680044 (+ 167us) server_negotiation.cc:299] Negotiation successful
0928 20:18:27.680190 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122,"thread_start_us":58,"threads_started":1}
I20260928 20:18:27.680306 9809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:27.661134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:33995 (local address 127.24.190.1:50095)
0928 20:18:27.661266 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:27.661278 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:27.661376 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:27.662247 (+ 871us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:27.662250 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:27.662719 (+ 469us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:27.662917 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:27.662924 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.664020 (+ 1096us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.664021 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:27.664794 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:27.664796 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:27.665404 (+ 608us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:27.665405 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:27.665494 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:27.674414 (+ 8920us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:27.674419 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:27.676194 (+ 1775us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:27.678489 (+ 2295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:27.678497 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:27.678500 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:27.678803 (+ 303us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:27.679066 (+ 263us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:27.679067 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:27.679068 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:27.679186 (+ 118us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:27.679859 (+ 673us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:27.679861 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:27.679909 (+ 48us) client_negotiation.cc:769] Sending connection context
0928 20:18:27.679981 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:18:27.680163 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":114,"mutex_wait_us":123,"thread_start_us":54,"threads_started":1}
W20260928 20:18:27.681171 9421 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
W20260928 20:18:27.681828 9420 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:27.681896 9420 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3811cbac8f4461bb074392178cf1847; no voters: 13c163ccd4b04d0794b2bf998eb1785c, 9c7e28faf2374c9e9986f451d14b5240
I20260928 20:18:27.682044 9807 raft_consensus.cc:2726] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:18:28.103657 9808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:28.103509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:40349)
0928 20:18:28.103576 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:28.103610 (+ 34us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 20:18:28.169333 9812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:28.169101 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:56807)
0928 20:18:28.169236 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:28.169274 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":56,"threads_started":1}
I20260928 20:18:28.296393 9813 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:28.296107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:41829)
0928 20:18:28.296306 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:28.296352 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":177,"thread_start_us":62,"threads_started":1}
I20260928 20:18:29.104494 9814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:29.104244 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:58945)
0928 20:18:29.104390 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:29.104436 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121,"thread_start_us":65,"threads_started":1}
I20260928 20:18:29.169987 9815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:29.169792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:54689)
0928 20:18:29.169907 (+ 115us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:29.169947 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97,"thread_start_us":71,"threads_started":1}
I20260928 20:18:29.297044 9816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:29.296836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:46783)
0928 20:18:29.296957 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:29.296999 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":60,"threads_started":1}
I20260928 20:18:29.496182 9817 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:29.496301 9817 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:29.496517 9817 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
W20260928 20:18:29.496938 9421 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
W20260928 20:18:29.497046 9420 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:29.497216 9420 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3811cbac8f4461bb074392178cf1847; no voters: 13c163ccd4b04d0794b2bf998eb1785c, 9c7e28faf2374c9e9986f451d14b5240
I20260928 20:18:29.497341 9817 raft_consensus.cc:2726] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:18:30.105187 9818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:30.104989 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:55287)
0928 20:18:30.105111 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:30.105141 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":107,"thread_start_us":70,"threads_started":1}
I20260928 20:18:30.170730 9819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:30.170431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:60597)
0928 20:18:30.170593 (+ 162us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:30.170640 (+ 47us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":142,"thread_start_us":57,"threads_started":1}
I20260928 20:18:30.297741 9820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:30.297540 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:51909)
0928 20:18:30.297658 (+ 118us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:30.297696 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102,"thread_start_us":62,"threads_started":1}
I20260928 20:18:31.105986 9821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:31.105694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:38475)
0928 20:18:31.105894 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:31.105932 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":181,"thread_start_us":153,"threads_started":1}
I20260928 20:18:31.171420 9822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:31.171204 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:45359)
0928 20:18:31.171336 (+ 132us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:31.171376 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":73,"threads_started":1}
I20260928 20:18:31.298480 9823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:31.298224 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:37237)
0928 20:18:31.298402 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:31.298433 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":132,"threads_started":1}
I20260928 20:18:31.922648 9824 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:31.922751 9824 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:31.922941 9824 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
W20260928 20:18:31.923353 9420 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
W20260928 20:18:31.923440 9421 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:31.923470 9420 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3811cbac8f4461bb074392178cf1847; no voters: 13c163ccd4b04d0794b2bf998eb1785c, 9c7e28faf2374c9e9986f451d14b5240
I20260928 20:18:31.923579 9824 raft_consensus.cc:2726] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:18:32.106755 9825 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:32.106538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:36561)
0928 20:18:32.106662 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:32.106706 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":64,"threads_started":1}
I20260928 20:18:32.172132 9826 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:32.171921 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:47463)
0928 20:18:32.172043 (+ 122us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:32.172086 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":103,"thread_start_us":59,"threads_started":1}
I20260928 20:18:32.299223 9827 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:32.299010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:53891)
0928 20:18:32.299133 (+ 123us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:32.299176 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105,"thread_start_us":59,"threads_started":1}
I20260928 20:18:33.107551 9828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:33.107280 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:45413)
0928 20:18:33.107408 (+ 128us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:33.107473 (+ 65us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":69,"threads_started":1}
I20260928 20:18:33.172822 9829 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:33.172607 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:60335)
0928 20:18:33.172731 (+ 124us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:33.172773 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106,"thread_start_us":62,"threads_started":1}
I20260928 20:18:33.300098 9830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:33.299862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:49561)
0928 20:18:33.299996 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:33.300038 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114,"thread_start_us":64,"threads_started":1}
I20260928 20:18:34.108333 9831 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:34.108049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:58941)
0928 20:18:34.108249 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:34.108286 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":182,"thread_start_us":135,"threads_started":1}
I20260928 20:18:34.173540 9832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:34.173318 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:43165)
0928 20:18:34.173460 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:34.173498 (+ 38us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":74,"threads_started":1}
I20260928 20:18:34.300978 9833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:34.300729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:44291)
0928 20:18:34.300889 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:34.300932 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139,"thread_start_us":65,"threads_started":1}
I20260928 20:18:35.109090 9834 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:35.108868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:46505)
0928 20:18:35.109007 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:35.109042 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":73,"threads_started":1}
I20260928 20:18:35.174259 9835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:35.174001 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:52353)
0928 20:18:35.174173 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:35.174213 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":149,"thread_start_us":77,"threads_started":1}
I20260928 20:18:35.301751 9836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:35.301490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:44435)
0928 20:18:35.301655 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:35.301698 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":146,"thread_start_us":66,"threads_started":1}
I20260928 20:18:35.430356 9837 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:35.430469 9837 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:35.430675 9837 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
W20260928 20:18:35.431066 9421 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
W20260928 20:18:35.431144 9420 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:35.431218 9420 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3811cbac8f4461bb074392178cf1847; no voters: 13c163ccd4b04d0794b2bf998eb1785c, 9c7e28faf2374c9e9986f451d14b5240
I20260928 20:18:35.431314 9837 raft_consensus.cc:2726] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:18:36.109892 9838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:36.109644 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:59827)
0928 20:18:36.109802 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:36.109846 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138,"thread_start_us":67,"threads_started":1}
I20260928 20:18:36.175113 9839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:36.174831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:44369)
0928 20:18:36.174980 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:36.175056 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":62,"threads_started":1}
I20260928 20:18:36.302557 9840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:36.302333 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:53117)
0928 20:18:36.302474 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:36.302509 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":80,"threads_started":1}
I20260928 20:18:36.964430 9841 raft_consensus.cc:482] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:36.964557 9841 raft_consensus.cc:504] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "13c163ccd4b04d0794b2bf998eb1785c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 35367 } } peers { permanent_uuid: "c3811cbac8f4461bb074392178cf1847" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46625 } } peers { permanent_uuid: "9c7e28faf2374c9e9986f451d14b5240" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 33995 } }
I20260928 20:18:36.964808 9841 leader_election.cc:288] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367), 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995)
W20260928 20:18:36.965183 9420 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 13c163ccd4b04d0794b2bf998eb1785c (127.24.190.3:35367): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
W20260928 20:18:36.965260 9421 leader_election.cc:341] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 9c7e28faf2374c9e9986f451d14b5240 (127.24.190.2:33995): Not found: Tablet not found: 59d8a690843f4b5db6cf0d8988688a5b
I20260928 20:18:36.965307 9421 leader_election.cc:302] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c3811cbac8f4461bb074392178cf1847; no voters: 13c163ccd4b04d0794b2bf998eb1785c, 9c7e28faf2374c9e9986f451d14b5240
I20260928 20:18:36.965404 9841 raft_consensus.cc:2726] T 59d8a690843f4b5db6cf0d8988688a5b P c3811cbac8f4461bb074392178cf1847 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260928 20:18:37.110695 9842 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:37.110478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:58203)
0928 20:18:37.110605 (+ 127us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:37.110647 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":64,"threads_started":1}
I20260928 20:18:37.175858 9843 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:37.175648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:46901)
0928 20:18:37.175769 (+ 121us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:37.175810 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100,"thread_start_us":59,"threads_started":1}
I20260928 20:18:37.303385 9844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:37.303102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:48931)
0928 20:18:37.303274 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:37.303331 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123,"thread_start_us":94,"threads_started":1}
I20260928 20:18:38.111414 9845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:38.111169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:33975)
0928 20:18:38.111325 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:38.111367 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":65,"threads_started":1}
I20260928 20:18:38.176563 9846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:38.176341 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:39421)
0928 20:18:38.176470 (+ 129us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:38.176516 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111,"thread_start_us":65,"threads_started":1}
I20260928 20:18:38.304105 9847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:38.303871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:41501)
0928 20:18:38.304012 (+ 141us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:38.304056 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":79,"threads_started":1}
I20260928 20:18:39.112130 9848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:39.111895 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:38135)
0928 20:18:39.112032 (+ 137us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:39.112068 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":87,"threads_started":1}
I20260928 20:18:39.177325 9849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:39.177082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:47799)
0928 20:18:39.177241 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:39.177280 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":141,"thread_start_us":78,"threads_started":1}
I20260928 20:18:39.305014 9850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:39.304788 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:50947)
0928 20:18:39.304926 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:39.304966 (+ 40us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":119,"thread_start_us":64,"threads_started":1}
I20260928 20:18:40.112919 9851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:40.112667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:44287)
0928 20:18:40.112822 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:40.112871 (+ 49us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":129,"thread_start_us":66,"threads_started":1}
I20260928 20:18:40.178117 9852 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:40.177891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:36217)
0928 20:18:40.178029 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:40.178071 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":63,"threads_started":1}
I20260928 20:18:40.305826 9853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:40.305611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:45939)
0928 20:18:40.305737 (+ 126us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:40.305780 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":108,"thread_start_us":63,"threads_started":1}
I20260928 20:18:41.113767 9854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:41.113492 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.1:60781)
0928 20:18:41.113682 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:41.113721 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":161,"thread_start_us":84,"threads_started":1}
I20260928 20:18:41.178905 9855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:41.178690 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.2:44487)
0928 20:18:41.178823 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:41.178860 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":117,"thread_start_us":67,"threads_started":1}
I20260928 20:18:41.302143 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9370
I20260928 20:18:41.306879 9856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:41.306585 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43023 (local address 127.24.190.3:38369)
0928 20:18:41.306744 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:41.306823 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.62:43023: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":137,"thread_start_us":73,"threads_started":1}
I20260928 20:18:41.307164 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9537
I20260928 20:18:41.311564 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9671
2026-09-28T20:18:41Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (58593 ms)
[----------] 30 tests from SecurityITest (238268 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:41 dist-test-slave-n45k krb5kdc[9859](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:41 dist-test-slave-n45k krb5kdc[9859](info): set up 2 sockets
Sep 28 20:18:41 dist-test-slave-n45k krb5kdc[9859](info): commencing operation
krb5kdc: starting...
W20260928 20:18:42.422472 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.090s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:42 dist-test-slave-n45k krb5kdc[9859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:42Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:18:42.551648 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37849
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:37849
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:42.633169 9872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:42.633375 9872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:42.633399 9872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:42.634527 9872 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:42.634563 9872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:42.634577 9872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:42.634590 9872 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:42.634603 9872 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:42.636013 9872 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:37849
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9872
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:42.636210 9872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:42.636384 9872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:42.642303 9878 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:42.642374 9877 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:42.642382 9872 server_base.cc:1034] running on GCE node
W20260928 20:18:42.642316 9880 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:42.642863 9872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:42.643157 9872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:42.644361 9872 hybrid_clock.cc:648] HybridClock initialized: now 1790626722644322 us; error 58 us; skew 500 ppm
Sep 28 20:18:42 dist-test-slave-n45k krb5kdc[9859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626722, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:42.647197 9872 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:18:42.647722 9872 webserver.cc:460] Webserver started at http://127.24.190.62:42777/ using document root <none> and password file <none>
I20260928 20:18:42.647975 9872 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:42.648044 9872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:42.648197 9872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:42.649340 9872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "9bf7be35fb914ed9bebc3670215d3275"
format_stamp: "Formatted at 2026-09-28 20:18:42 on dist-test-slave-n45k"
server_key: "1b9f367329fbc7bc52c792e9cb1faa57"
server_key_iv: "669a77dbcdbb84b82382e550605e59ef"
server_key_version: "encryptionkey@0"
I20260928 20:18:42.649708 9872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "9bf7be35fb914ed9bebc3670215d3275"
format_stamp: "Formatted at 2026-09-28 20:18:42 on dist-test-slave-n45k"
server_key: "1b9f367329fbc7bc52c792e9cb1faa57"
server_key_iv: "669a77dbcdbb84b82382e550605e59ef"
server_key_version: "encryptionkey@0"
I20260928 20:18:42.651278 9872 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:42.652174 9887 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:42.652457 9872 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:42.652592 9872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "9bf7be35fb914ed9bebc3670215d3275"
format_stamp: "Formatted at 2026-09-28 20:18:42 on dist-test-slave-n45k"
server_key: "1b9f367329fbc7bc52c792e9cb1faa57"
server_key_iv: "669a77dbcdbb84b82382e550605e59ef"
server_key_version: "encryptionkey@0"
I20260928 20:18:42.652686 9872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:42.663926 9872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:42.666371 9872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:42.666533 9872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:42.670527 9872 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:37849
I20260928 20:18:42.670598 9939 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:37849 every 8 connection(s)
I20260928 20:18:42.670955 9872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:42.671798 9940 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:42.674091 9940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275: Bootstrap starting.
I20260928 20:18:42.674705 9940 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:42.674937 9940 log.cc:824] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:42.675640 9940 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275: No bootstrap required, opened a new log
I20260928 20:18:42.677340 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9872
I20260928 20:18:42.677451 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:42.677502 9940 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf7be35fb914ed9bebc3670215d3275" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37849 } }
I20260928 20:18:42.677659 25336 external_mini_cluster.cc:1428] Setting key 31b51c5903d1ed9678edb8c3e135807d
I20260928 20:18:42.677685 9940 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:42.677726 9940 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bf7be35fb914ed9bebc3670215d3275, State: Initialized, Role: FOLLOWER
I20260928 20:18:42.677875 9940 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf7be35fb914ed9bebc3670215d3275" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37849 } }
I20260928 20:18:42.677992 9940 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:42.678028 9940 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:42.678124 9940 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:42.679235 9940 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf7be35fb914ed9bebc3670215d3275" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37849 } }
I20260928 20:18:42.679369 9940 leader_election.cc:302] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bf7be35fb914ed9bebc3670215d3275; no voters:
I20260928 20:18:42.679534 9940 leader_election.cc:288] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:42.679633 9945 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:42.679776 9940 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:42.679816 9945 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [term 1 LEADER]: Becoming Leader. State: Replica: 9bf7be35fb914ed9bebc3670215d3275, State: Running, Role: LEADER
I20260928 20:18:42.680032 9945 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf7be35fb914ed9bebc3670215d3275" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37849 } }
I20260928 20:18:42.680591 9946 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bf7be35fb914ed9bebc3670215d3275" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf7be35fb914ed9bebc3670215d3275" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37849 } } }
I20260928 20:18:42.680694 9946 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:42.680657 9947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bf7be35fb914ed9bebc3670215d3275. Latest consensus state: current_term: 1 leader_uuid: "9bf7be35fb914ed9bebc3670215d3275" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bf7be35fb914ed9bebc3670215d3275" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37849 } } }
I20260928 20:18:42.680733 9947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:42.681237 9952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:42.681763 9952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:42.683401 9952 catalog_manager.cc:1347] Generated new cluster ID: ca059f99a72b41ee856722cec2b9a9ef
I20260928 20:18:42.683452 9952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:18:42 dist-test-slave-n45k krb5kdc[9859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626722, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:42.689330 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:42.678089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52860 (local address 127.24.190.62:37849)
0928 20:18:42.678324 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:42.678333 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:42.678366 (+ 33us) server_negotiation.cc:407] Connection header received
0928 20:18:42.678488 (+ 122us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:42.678495 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:42.678568 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:42.678756 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:42.679348 (+ 592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:42.680905 (+ 1557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:42.682015 (+ 1110us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:42.682566 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:42.682697 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:42.685700 (+ 3003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:42.685704 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:42.685704 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:42.685716 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:42.687704 (+ 1988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:42.688133 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:42.688136 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:42.688136 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:42.688242 (+ 106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:42.688456 (+ 214us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:42.688457 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:42.688457 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:42.688739 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:42.688882 (+ 143us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:42.689009 (+ 127us) server_negotiation.cc:299] Negotiation successful
0928 20:18:42.689139 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":188,"thread_start_us":92,"threads_started":1}
I20260928 20:18:42.709695 9952 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:42.710564 9952 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:42.716334 9952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275: Generated new TSK 0
I20260928 20:18:42.716553 9952 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:18:42.745698 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37849
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:42.829252 9966 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:42.829478 9966 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:42.829524 9966 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:42.830789 9966 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:42.830835 9966 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:42.830862 9966 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:42.832345 9966 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.9966
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:42.832546 9966 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:42.832728 9966 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:42.838558 9974 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:42.838792 9971 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:42.839002 9966 server_base.cc:1034] running on GCE node
W20260928 20:18:42.839114 9972 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:42.839464 9966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:42.839732 9966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:42.841372 9966 hybrid_clock.cc:648] HybridClock initialized: now 1790626722841348 us; error 37 us; skew 500 ppm
Sep 28 20:18:42 dist-test-slave-n45k krb5kdc[9859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626722, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:42.855958 9966 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:18:42.857026 9966 webserver.cc:460] Webserver started at http://127.24.190.1:42537/ using document root <none> and password file <none>
I20260928 20:18:42.857889 9966 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:42.857971 9966 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:42.858083 9966 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:42.860921 9966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "151bb2234af04c9680413c718c53181b"
format_stamp: "Formatted at 2026-09-28 20:18:42 on dist-test-slave-n45k"
server_key: "7b3ec16feaa02d89b160b60349c7d680"
server_key_iv: "0cc9045131fb746a829db007947e56bd"
server_key_version: "encryptionkey@0"
I20260928 20:18:42.861389 9966 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "151bb2234af04c9680413c718c53181b"
format_stamp: "Formatted at 2026-09-28 20:18:42 on dist-test-slave-n45k"
server_key: "7b3ec16feaa02d89b160b60349c7d680"
server_key_iv: "0cc9045131fb746a829db007947e56bd"
server_key_version: "encryptionkey@0"
I20260928 20:18:42.864876 9966 fs_manager.cc:691] Time spent creating directory manager: real 0.003s user 0.002s sys 0.004s
I20260928 20:18:42.866077 9981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:42.866470 9966 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:42.866655 9966 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "151bb2234af04c9680413c718c53181b"
format_stamp: "Formatted at 2026-09-28 20:18:42 on dist-test-slave-n45k"
server_key: "7b3ec16feaa02d89b160b60349c7d680"
server_key_iv: "0cc9045131fb746a829db007947e56bd"
server_key_version: "encryptionkey@0"
I20260928 20:18:42.866745 9966 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:42.885193 9966 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:42.887626 9966 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:42.887809 9966 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:42.888085 9966 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:42.888521 9966 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:42.888582 9966 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:42.888617 9966 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:42.888644 9966 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:42.894955 9966 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:43805
I20260928 20:18:42.895033 10094 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:43805 every 8 connection(s)
I20260928 20:18:42.895378 9966 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:42.901589 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 9966
I20260928 20:18:42.901685 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:18:42.901908 25336 external_mini_cluster.cc:1428] Setting key 5114eb45c08a07a39b4a9c2963edfcaa
Sep 28 20:18:42 dist-test-slave-n45k krb5kdc[9859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626722, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:42.905697 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:42.896241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:58953 (local address 127.24.190.62:37849)
0928 20:18:42.896344 (+ 103us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:42.896346 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:42.896532 (+ 186us) server_negotiation.cc:407] Connection header received
0928 20:18:42.897186 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:42.897187 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:42.897204 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:42.897285 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:42.898304 (+ 1019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:42.898817 (+ 513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:42.899868 (+ 1051us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:42.900088 (+ 220us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:42.900171 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:42.902646 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:42.902647 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:42.902648 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:42.902655 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:42.904166 (+ 1511us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:42.904614 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:42.904616 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:42.904616 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:42.904679 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:42.904946 (+ 267us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:42.904947 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:42.904948 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:42.905104 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:42.905169 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:42.905514 (+ 345us) server_negotiation.cc:299] Negotiation successful
0928 20:18:42.905603 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260928 20:18:42.905910 10097 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:42.896156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37849 (local address 127.24.190.1:58953)
0928 20:18:42.896391 (+ 235us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:42.896443 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:42.896975 (+ 532us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:42.897374 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:42.897378 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:42.897977 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:42.898176 (+ 199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:42.898181 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:42.898922 (+ 741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:42.898923 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:42.899764 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:42.899766 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:42.900192 (+ 426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:42.900193 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:42.900327 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:42.900902 (+ 575us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:42.900910 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:42.902553 (+ 1643us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:42.904275 (+ 1722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:42.904283 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:42.904286 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:42.904527 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:42.904752 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:42.904753 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:42.904753 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:42.904874 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:42.905199 (+ 325us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:42.905207 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:42.905365 (+ 158us) client_negotiation.cc:769] Sending connection context
0928 20:18:42.905479 (+ 114us) client_negotiation.cc:240] Negotiation successful
0928 20:18:42.905658 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191,"thread_start_us":97,"threads_started":1}
I20260928 20:18:42.906603 10095 heartbeater.cc:347] Connected to a master server at 127.24.190.62:37849
I20260928 20:18:42.906705 10095 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:42.906906 10095 heartbeater.cc:511] Master 127.24.190.62:37849 requested a full tablet report, sending...
I20260928 20:18:42.907449 9904 ts_manager.cc:194] Registered new tserver with Master: 151bb2234af04c9680413c718c53181b (127.24.190.1:43805)
I20260928 20:18:42.908072 9904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:58953
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:18:42.929914 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37849
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:43.011511 10100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:43.011752 10100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:43.011790 10100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:43.012931 10100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:43.013001 10100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:43.013046 10100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:43.014513 10100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10100
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:43.014782 10100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:43.015013 10100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:43.020241 10106 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.020288 10105 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.020201 10108 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:43.020299 10100 server_base.cc:1034] running on GCE node
I20260928 20:18:43.020576 10100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:43.020782 10100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:43.021926 10100 hybrid_clock.cc:648] HybridClock initialized: now 1790626723021916 us; error 32 us; skew 500 ppm
Sep 28 20:18:43 dist-test-slave-n45k krb5kdc[9859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626723, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:43.024732 10100 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:18:43.025216 10100 webserver.cc:460] Webserver started at http://127.24.190.2:46519/ using document root <none> and password file <none>
I20260928 20:18:43.025453 10100 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:43.025521 10100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:43.025677 10100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:43.026867 10100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "9a809527c85e4f95b6a15f28b7f3bcde"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "24af379fccd35a72eceb02ed48de3b01"
server_key_iv: "8440ca66bc57d824c83339f610ebe074"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.027240 10100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "9a809527c85e4f95b6a15f28b7f3bcde"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "24af379fccd35a72eceb02ed48de3b01"
server_key_iv: "8440ca66bc57d824c83339f610ebe074"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.028661 10100 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:18:43.029531 10115 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.029785 10100 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:43.029904 10100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "9a809527c85e4f95b6a15f28b7f3bcde"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "24af379fccd35a72eceb02ed48de3b01"
server_key_iv: "8440ca66bc57d824c83339f610ebe074"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.029982 10100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:43.049079 10100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:43.051327 10100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:43.051501 10100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:43.051779 10100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:43.052107 10100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:43.052172 10100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.052214 10100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:43.052241 10100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.058863 10100 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:46685
I20260928 20:18:43.058955 10228 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:46685 every 8 connection(s)
I20260928 20:18:43.059294 10100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:18:43.065371 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10100
I20260928 20:18:43.065495 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:18:43.065757 25336 external_mini_cluster.cc:1428] Setting key 0e851db5e6f97058c6c128c762f4112b
Sep 28 20:18:43 dist-test-slave-n45k krb5kdc[9859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626723, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:43.069813 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.060126 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:57347 (local address 127.24.190.62:37849)
0928 20:18:43.060216 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.060219 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.060389 (+ 170us) server_negotiation.cc:407] Connection header received
0928 20:18:43.060888 (+ 499us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.060889 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.060900 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.060959 (+ 59us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:43.061935 (+ 976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.062465 (+ 530us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.063581 (+ 1116us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.063791 (+ 210us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.063861 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.066719 (+ 2858us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:43.066721 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:43.066721 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:43.066729 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:43.068291 (+ 1562us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:43.068786 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:43.068787 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:43.068788 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:43.068848 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:43.069127 (+ 279us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:43.069128 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:43.069128 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:43.069249 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:43.069323 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.069609 (+ 286us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.069712 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 20:18:43.070055 10231 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.060077 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37849 (local address 127.24.190.2:57347)
0928 20:18:43.060262 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.060299 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.060772 (+ 473us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.061032 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.061035 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.061621 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:43.061821 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.061825 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.062561 (+ 736us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.062563 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.063487 (+ 924us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.063490 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.063888 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.063889 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.064003 (+ 114us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.064660 (+ 657us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:43.064675 (+ 15us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:43.066552 (+ 1877us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:43.068389 (+ 1837us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:43.068397 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:43.068400 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:43.068690 (+ 290us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:43.068928 (+ 238us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:43.068928 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:43.068929 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:43.069049 (+ 120us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:43.069325 (+ 276us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:43.069333 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:43.069477 (+ 144us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.069597 (+ 120us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.069818 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":133,"thread_start_us":100,"threads_started":1}
I20260928 20:18:43.070597 10229 heartbeater.cc:347] Connected to a master server at 127.24.190.62:37849
I20260928 20:18:43.070755 10229 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:43.070999 10229 heartbeater.cc:511] Master 127.24.190.62:37849 requested a full tablet report, sending...
I20260928 20:18:43.071476 9904 ts_manager.cc:194] Registered new tserver with Master: 9a809527c85e4f95b6a15f28b7f3bcde (127.24.190.2:46685)
I20260928 20:18:43.071923 9904 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:57347
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:18:43.093667 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37849
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:34239
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:43.181474 10234 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:43.181727 10234 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:43.181756 10234 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:43.182952 10234 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:43.182997 10234 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:43.183024 10234 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:43.184463 10234 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:34239
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:37849
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10234
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:43.184674 10234 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:43.184856 10234 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:43.190362 10242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.190312 10239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.190263 10240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:43.190330 10234 server_base.cc:1034] running on GCE node
I20260928 20:18:43.190752 10234 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:43.190955 10234 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:43.192160 10234 hybrid_clock.cc:648] HybridClock initialized: now 1790626723192083 us; error 28 us; skew 500 ppm
Sep 28 20:18:43 dist-test-slave-n45k krb5kdc[9859](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626723, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:43.194872 10234 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:18:43.195447 10234 webserver.cc:460] Webserver started at http://127.24.190.3:34593/ using document root <none> and password file <none>
I20260928 20:18:43.195696 10234 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:43.195744 10234 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:43.195886 10234 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:43.196973 10234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "c42a9f2128834919b256a174728b4a0c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "e00517cff0874b307b21ff7b0c28af0c"
server_key_iv: "263b5968346ec3ef0bba409dee70c32d"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.197337 10234 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "c42a9f2128834919b256a174728b4a0c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "e00517cff0874b307b21ff7b0c28af0c"
server_key_iv: "263b5968346ec3ef0bba409dee70c32d"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.198770 10234 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:43.199559 10249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.199846 10234 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:43.199951 10234 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "c42a9f2128834919b256a174728b4a0c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "e00517cff0874b307b21ff7b0c28af0c"
server_key_iv: "263b5968346ec3ef0bba409dee70c32d"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.200035 10234 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:43.209574 10234 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:43.211784 10234 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:43.211974 10234 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:43.212215 10234 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:43.212510 10234 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:43.212566 10234 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.212606 10234 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:43.212626 10234 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.219767 10234 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:43699
I20260928 20:18:43.219834 10362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:43699 every 8 connection(s)
I20260928 20:18:43.220192 10234 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:18:43.220613 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10234
I20260928 20:18:43.220737 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:18:43.220885 25336 external_mini_cluster.cc:1428] Setting key ca2f3de5daad611a510bd55126028526
Sep 28 20:18:43 dist-test-slave-n45k krb5kdc[9859](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626723, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:43.230561 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.221042 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:46421 (local address 127.24.190.62:37849)
0928 20:18:43.221092 (+ 50us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.221094 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.221410 (+ 316us) server_negotiation.cc:407] Connection header received
0928 20:18:43.221933 (+ 523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.221934 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.221945 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.221990 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:43.223035 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.223572 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.224713 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.224908 (+ 195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.224983 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.227354 (+ 2371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:43.227356 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:43.227356 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:43.227364 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:43.228954 (+ 1590us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:43.229369 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:43.229370 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:43.229371 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:43.229422 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:43.229651 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:43.229701 (+ 50us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:43.229701 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:43.229822 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:43.229880 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.230410 (+ 530us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.230492 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:18:43.230836 10365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.221049 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37849 (local address 127.24.190.3:46421)
0928 20:18:43.221297 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.221338 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.221825 (+ 487us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.222060 (+ 235us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.222064 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.222731 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:43.222928 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.222933 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.223722 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.223723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.224593 (+ 870us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.224596 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.225002 (+ 406us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.225003 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.225122 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.225643 (+ 521us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:43.225653 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:43.227253 (+ 1600us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:43.229050 (+ 1797us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:43.229056 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:43.229057 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:43.229296 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:43.229485 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:43.229486 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:43.229486 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:43.229588 (+ 102us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:43.229915 (+ 327us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:43.229921 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:43.230065 (+ 144us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.230389 (+ 324us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.230543 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":207,"thread_start_us":179,"threads_started":1}
I20260928 20:18:43.231417 10363 heartbeater.cc:347] Connected to a master server at 127.24.190.62:37849
I20260928 20:18:43.231508 10363 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:43.231735 10363 heartbeater.cc:511] Master 127.24.190.62:37849 requested a full tablet report, sending...
I20260928 20:18:43.232152 9903 ts_manager.cc:194] Registered new tserver with Master: c42a9f2128834919b256a174728b4a0c (127.24.190.3:43699)
I20260928 20:18:43.232589 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:43.232692 9903 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:46421
I20260928 20:18:43.240628 9944 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.234175 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52872 (local address 127.24.190.62:37849)
0928 20:18:43.234240 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.234242 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.234454 (+ 212us) server_negotiation.cc:407] Connection header received
0928 20:18:43.234527 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.234528 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.234539 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.234593 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:43.235217 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.235688 (+ 471us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.236445 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.236653 (+ 208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.236739 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.238031 (+ 1292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:43.238032 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:43.238033 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:43.238040 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:43.239416 (+ 1376us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:43.239779 (+ 363us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:43.239780 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:43.239781 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:43.239841 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:43.240045 (+ 204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:43.240046 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:43.240046 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:43.240217 (+ 171us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:43.240336 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.240437 (+ 101us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.240520 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:18:43.242564 9903 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52872:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:43.244199 9903 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:43.251767 10375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.246994 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:46685 (local address 127.0.0.1:34142)
0928 20:18:43.247624 (+ 630us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.247657 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.247759 (+ 102us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.248201 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.248204 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.248207 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:43.248295 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.248297 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.249334 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.249335 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.250463 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.250465 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.251422 (+ 957us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.251423 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.251510 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.251526 (+ 16us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.251612 (+ 86us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.251678 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":133,"threads_started":1}
I20260928 20:18:43.251771 10377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.247177 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34142 (local address 127.24.190.2:46685)
0928 20:18:43.247354 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.247360 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.247740 (+ 380us) server_negotiation.cc:407] Connection header received
0928 20:18:43.247866 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.247869 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.247920 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.248010 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:43.248364 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.249224 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.250554 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.251321 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.251398 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.251457 (+ 59us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.251637 (+ 180us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.251676 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":139,"thread_start_us":99,"threads_started":1}
I20260928 20:18:43.252324 10374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.246999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:43805 (local address 127.0.0.1:36316)
0928 20:18:43.247871 (+ 872us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.247881 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.248084 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.248366 (+ 282us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.248367 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.248370 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:43.248429 (+ 59us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.248431 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.249804 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.249805 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.251015 (+ 1210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.251018 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.252072 (+ 1054us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.252073 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.252138 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.252141 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.252198 (+ 57us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.252239 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":860,"mutex_wait_us":26,"thread_start_us":75,"threads_started":1}
I20260928 20:18:43.252377 10379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.247381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36316 (local address 127.24.190.1:43805)
0928 20:18:43.247553 (+ 172us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.247556 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.247933 (+ 377us) server_negotiation.cc:407] Connection header received
0928 20:18:43.248255 (+ 322us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.248259 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.248277 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.248356 (+ 79us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:43.248488 (+ 132us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.249679 (+ 1191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.251118 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.251895 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.251945 (+ 50us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.252008 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.252231 (+ 223us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.252282 (+ 51us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":149,"thread_start_us":75,"threads_started":1}
I20260928 20:18:43.252153 10378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.247312 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34456 (local address 127.24.190.3:43699)
0928 20:18:43.247503 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.247507 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.248368 (+ 861us) server_negotiation.cc:407] Connection header received
0928 20:18:43.248416 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.248418 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.248435 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.248505 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:43.248714 (+ 209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.249774 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.250946 (+ 1172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.251609 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.251672 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.251726 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.252021 (+ 295us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.252076 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154,"thread_start_us":97,"threads_started":1}
I20260928 20:18:43.252080 10376 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.247000 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:43699 (local address 127.0.0.1:34456)
0928 20:18:43.247981 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.247990 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.248034 (+ 44us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.248595 (+ 561us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.248596 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.248598 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:43.248634 (+ 36us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.248635 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.249882 (+ 1247us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.249883 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.250860 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.250862 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.251759 (+ 897us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.251760 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.251823 (+ 63us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.251828 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.251977 (+ 149us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.252019 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":965,"mutex_wait_us":4,"thread_start_us":84,"threads_started":1}
I20260928 20:18:43.253042 10163 tablet_service.cc:1467] Processing CreateTablet for tablet e9fecbcc15bd481d982e430eeafb075c (DEFAULT_TABLE table=test-table [id=0a04e5d66ab041308d58113a2362abe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:43.253432 10163 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fecbcc15bd481d982e430eeafb075c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:43.253384 10029 tablet_service.cc:1467] Processing CreateTablet for tablet e9fecbcc15bd481d982e430eeafb075c (DEFAULT_TABLE table=test-table [id=0a04e5d66ab041308d58113a2362abe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:43.253424 10297 tablet_service.cc:1467] Processing CreateTablet for tablet e9fecbcc15bd481d982e430eeafb075c (DEFAULT_TABLE table=test-table [id=0a04e5d66ab041308d58113a2362abe1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:43.253711 10029 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fecbcc15bd481d982e430eeafb075c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:43.253750 10297 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9fecbcc15bd481d982e430eeafb075c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:43.257023 10380 tablet_bootstrap.cc:492] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Bootstrap starting.
I20260928 20:18:43.257325 10382 tablet_bootstrap.cc:492] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: Bootstrap starting.
I20260928 20:18:43.257725 10380 tablet_bootstrap.cc:654] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:43.257972 10382 tablet_bootstrap.cc:654] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:43.258330 10380 log.cc:824] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:43.258459 10381 tablet_bootstrap.cc:492] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Bootstrap starting.
I20260928 20:18:43.258618 10382 log.cc:824] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:43.259196 10381 tablet_bootstrap.cc:654] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:43.259590 10382 tablet_bootstrap.cc:492] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: No bootstrap required, opened a new log
I20260928 20:18:43.259670 10382 ts_tablet_manager.cc:1397] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260928 20:18:43.259755 10381 log.cc:824] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:43.260529 10381 tablet_bootstrap.cc:492] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: No bootstrap required, opened a new log
I20260928 20:18:43.260543 10380 tablet_bootstrap.cc:492] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: No bootstrap required, opened a new log
I20260928 20:18:43.260610 10380 ts_tablet_manager.cc:1397] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260928 20:18:43.260644 10381 ts_tablet_manager.cc:1397] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:18:43.261356 10382 raft_consensus.cc:348] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.261497 10382 raft_consensus.cc:374] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:43.261519 10382 raft_consensus.cc:729] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 151bb2234af04c9680413c718c53181b, State: Initialized, Role: FOLLOWER
I20260928 20:18:43.261658 10382 consensus_queue.cc:260] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.261946 10095 heartbeater.cc:503] Master 127.24.190.62:37849 was elected leader, sending a full tablet report...
I20260928 20:18:43.261940 10382 ts_tablet_manager.cc:1428] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260928 20:18:43.262640 10380 raft_consensus.cc:348] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.262648 10381 raft_consensus.cc:348] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.262821 10381 raft_consensus.cc:374] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:43.262821 10380 raft_consensus.cc:374] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:43.262858 10380 raft_consensus.cc:729] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c42a9f2128834919b256a174728b4a0c, State: Initialized, Role: FOLLOWER
I20260928 20:18:43.262858 10381 raft_consensus.cc:729] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a809527c85e4f95b6a15f28b7f3bcde, State: Initialized, Role: FOLLOWER
I20260928 20:18:43.262964 10380 consensus_queue.cc:260] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.262984 10381 consensus_queue.cc:260] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.263243 10381 ts_tablet_manager.cc:1428] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 20:18:43.263253 10380 ts_tablet_manager.cc:1428] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260928 20:18:43.263255 10363 heartbeater.cc:503] Master 127.24.190.62:37849 was elected leader, sending a full tablet report...
I20260928 20:18:43.263356 10229 heartbeater.cc:503] Master 127.24.190.62:37849 was elected leader, sending a full tablet report...
W20260928 20:18:43.309952 10230 tablet.cc:2369] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:43.366605 10388 raft_consensus.cc:482] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:43.366748 10388 raft_consensus.cc:504] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.367213 10388 leader_election.cc:288] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 151bb2234af04c9680413c718c53181b (127.24.190.1:43805), 9a809527c85e4f95b6a15f28b7f3bcde (127.24.190.2:46685)
I20260928 20:18:43.371330 10379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.367531 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:50723 (local address 127.24.190.1:43805)
0928 20:18:43.367582 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.367584 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.367593 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:43.367621 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.367622 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.367631 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.367721 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:43.367884 (+ 163us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.368734 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.370247 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.370891 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.370973 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.370982 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.371198 (+ 216us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.371258 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 20:18:43.371340 10365 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.367367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:43805 (local address 127.24.190.3:50723)
0928 20:18:43.367443 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.367456 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.367509 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.367739 (+ 230us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.367740 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.367742 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:43.367811 (+ 69us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.367812 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.368813 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.368813 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.370137 (+ 1324us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.370141 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.371005 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.371007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.371102 (+ 95us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.371107 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.371185 (+ 78us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.371240 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":80}
I20260928 20:18:43.371376 10377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.367503 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:33505 (local address 127.24.190.2:46685)
0928 20:18:43.367552 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.367554 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.367676 (+ 122us) server_negotiation.cc:407] Connection header received
0928 20:18:43.367753 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.367754 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.367763 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.367819 (+ 56us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:43.367940 (+ 121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.368649 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.370339 (+ 1690us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.370912 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.370978 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.370985 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.371264 (+ 279us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.371307 (+ 43us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:18:43.371351 10389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.367417 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:46685 (local address 127.24.190.3:33505)
0928 20:18:43.367605 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.367613 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.367679 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.367824 (+ 145us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.367824 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.367826 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:43.367882 (+ 56us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.367883 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.368744 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.368745 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.370245 (+ 1500us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.370247 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.371005 (+ 758us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.371007 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.371186 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.371190 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.371243 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.371270 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173,"mutex_wait_us":53,"thread_start_us":124,"threads_started":1}
I20260928 20:18:43.371819 10183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fecbcc15bd481d982e430eeafb075c" candidate_uuid: "c42a9f2128834919b256a174728b4a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" is_pre_election: true
I20260928 20:18:43.372004 10183 raft_consensus.cc:2454] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c42a9f2128834919b256a174728b4a0c in term 0.
I20260928 20:18:43.372027 10049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fecbcc15bd481d982e430eeafb075c" candidate_uuid: "c42a9f2128834919b256a174728b4a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "151bb2234af04c9680413c718c53181b" is_pre_election: true
I20260928 20:18:43.372195 10049 raft_consensus.cc:2454] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c42a9f2128834919b256a174728b4a0c in term 0.
I20260928 20:18:43.372265 10251 leader_election.cc:302] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a809527c85e4f95b6a15f28b7f3bcde, c42a9f2128834919b256a174728b4a0c; no voters:
I20260928 20:18:43.372424 10388 raft_consensus.cc:2781] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:43.372484 10388 raft_consensus.cc:482] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:43.372501 10388 raft_consensus.cc:3037] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:43.373281 10388 raft_consensus.cc:504] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.373447 10388 leader_election.cc:288] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [CANDIDATE]: Term 1 election: Requested vote from peers 151bb2234af04c9680413c718c53181b (127.24.190.1:43805), 9a809527c85e4f95b6a15f28b7f3bcde (127.24.190.2:46685)
I20260928 20:18:43.373617 10049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fecbcc15bd481d982e430eeafb075c" candidate_uuid: "c42a9f2128834919b256a174728b4a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "151bb2234af04c9680413c718c53181b"
I20260928 20:18:43.373616 10183 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9fecbcc15bd481d982e430eeafb075c" candidate_uuid: "c42a9f2128834919b256a174728b4a0c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a809527c85e4f95b6a15f28b7f3bcde"
I20260928 20:18:43.373705 10183 raft_consensus.cc:3037] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:43.373705 10049 raft_consensus.cc:3037] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:43.374720 10183 raft_consensus.cc:2454] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c42a9f2128834919b256a174728b4a0c in term 1.
I20260928 20:18:43.374720 10049 raft_consensus.cc:2454] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c42a9f2128834919b256a174728b4a0c in term 1.
I20260928 20:18:43.374938 10251 leader_election.cc:302] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a809527c85e4f95b6a15f28b7f3bcde, c42a9f2128834919b256a174728b4a0c; no voters:
I20260928 20:18:43.375051 10388 raft_consensus.cc:2781] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:43.375232 10388 raft_consensus.cc:686] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 1 LEADER]: Becoming Leader. State: Replica: c42a9f2128834919b256a174728b4a0c, State: Running, Role: LEADER
I20260928 20:18:43.375352 10388 consensus_queue.cc:237] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } }
I20260928 20:18:43.376286 9903 catalog_manager.cc:5495] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c reported cstate change: term changed from 0 to 1, leader changed from <none> to c42a9f2128834919b256a174728b4a0c (127.24.190.3). New cstate: current_term: 1 leader_uuid: "c42a9f2128834919b256a174728b4a0c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c42a9f2128834919b256a174728b4a0c" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 43699 } health_report { overall_health: HEALTHY } } }
W20260928 20:18:43.396270 10096 tablet.cc:2369] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:43.397899 10378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.395291 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34470 (local address 127.24.190.3:43699)
0928 20:18:43.395354 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.395356 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.395366 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:18:43.395401 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.395402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.395420 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.395482 (+ 62us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:43.395651 (+ 169us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.396248 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.397138 (+ 890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.397330 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.397389 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.397610 (+ 221us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:43.397706 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:43.397771 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.397807 (+ 36us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.397826 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":38}
I20260928 20:18:43.400127 10183 raft_consensus.cc:1261] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 1 FOLLOWER]: Refusing update from remote peer c42a9f2128834919b256a174728b4a0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:43.400128 10049 raft_consensus.cc:1261] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 1 FOLLOWER]: Refusing update from remote peer c42a9f2128834919b256a174728b4a0c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:43.400570 10390 consensus_queue.cc:1035] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a809527c85e4f95b6a15f28b7f3bcde" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 46685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:43.400730 10388 consensus_queue.cc:1035] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [LEADER]: Connected to new peer: Peer: permanent_uuid: "151bb2234af04c9680413c718c53181b" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 43805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:43.404088 10395 mvcc.cc:205] Tried to move back new op lower bound from 7334407059044179968 to 7334407058946289664. Current Snapshot: MvccSnapshot[applied={T|T < 7334407059044179968 or (T in {7334407059044179968})}]
I20260928 20:18:43.404248 10394 mvcc.cc:205] Tried to move back new op lower bound from 7334407059044179968 to 7334407058946289664. Current Snapshot: MvccSnapshot[applied={T|T < 7334407059044179968}]
I20260928 20:18:43.405694 9904 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:43.405797 9904 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52872:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:43.406643 9904 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bf7be35fb914ed9bebc3670215d3275: Sending DeleteTablet for 3 replicas of tablet e9fecbcc15bd481d982e430eeafb075c
I20260928 20:18:43.406960 10029 tablet_service.cc:1514] Processing DeleteTablet for tablet e9fecbcc15bd481d982e430eeafb075c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:43 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:36316
I20260928 20:18:43.406970 10297 tablet_service.cc:1514] Processing DeleteTablet for tablet e9fecbcc15bd481d982e430eeafb075c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:43 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:34456
I20260928 20:18:43.407009 10163 tablet_service.cc:1514] Processing DeleteTablet for tablet e9fecbcc15bd481d982e430eeafb075c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:43 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:34142
I20260928 20:18:43.407251 10405 tablet_replica.cc:330] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: stopping tablet replica
I20260928 20:18:43.407325 10403 tablet_replica.cc:330] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b: stopping tablet replica
I20260928 20:18:43.407428 10405 raft_consensus.cc:2229] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:43.407471 10403 raft_consensus.cc:2229] T e9fecbcc15bd481d982e430eeafb075c P 151bb2234af04c9680413c718c53181b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:43.407572 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9966
I20260928 20:18:43.407612 10405 raft_consensus.cc:2258] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:43.408619 10405 ts_tablet_manager.cc:1905] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:43.408710 10404 tablet_replica.cc:330] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: stopping tablet replica
I20260928 20:18:43.408797 10404 raft_consensus.cc:2229] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:18:43.408885 10404 raft_consensus.cc:2258] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:43.409343 10404 ts_tablet_manager.cc:1905] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:43.410671 10405 ts_tablet_manager.cc:1918] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:43.410808 10405 log.cc:1196] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/e9fecbcc15bd481d982e430eeafb075c
I20260928 20:18:43.411168 10405 ts_tablet_manager.cc:1939] T e9fecbcc15bd481d982e430eeafb075c P 9a809527c85e4f95b6a15f28b7f3bcde: Deleting consensus metadata
I20260928 20:18:43.411460 10404 ts_tablet_manager.cc:1918] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:43.411571 10404 log.cc:1196] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/e9fecbcc15bd481d982e430eeafb075c
I20260928 20:18:43.411713 9889 catalog_manager.cc:4841] TS 9a809527c85e4f95b6a15f28b7f3bcde (127.24.190.2:46685): tablet e9fecbcc15bd481d982e430eeafb075c (table test-table [id=0a04e5d66ab041308d58113a2362abe1]) successfully deleted
I20260928 20:18:43.411856 10404 ts_tablet_manager.cc:1939] T e9fecbcc15bd481d982e430eeafb075c P c42a9f2128834919b256a174728b4a0c: Deleting consensus metadata
I20260928 20:18:43.412325 9890 catalog_manager.cc:4841] TS c42a9f2128834919b256a174728b4a0c (127.24.190.3:43699): tablet e9fecbcc15bd481d982e430eeafb075c (table test-table [id=0a04e5d66ab041308d58113a2362abe1]) successfully deleted
W20260928 20:18:43.414131 9891 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:43805 (error 108)
I20260928 20:18:43.414403 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10100
I20260928 20:18:43.415079 10374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.414538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:43805 (local address 127.0.0.1:36332)
0928 20:18:43.414992 (+ 454us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.415037 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:43805: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":432}
W20260928 20:18:43.416311 9891 catalog_manager.cc:4584] TS 151bb2234af04c9680413c718c53181b (127.24.190.1:43805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e9fecbcc15bd481d982e430eeafb075c: Network error: Client connection negotiation failed: client connection to 127.24.190.1:43805: connect: Connection refused (error 111)
I20260928 20:18:43.419579 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10234
I20260928 20:18:43.424238 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 9872
2026-09-28T20:18:43Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (2112 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-09-28T20:18:43Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:43Z Disabled control of system clock
I20260928 20:18:43.452780 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43953
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:46483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:43953
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:43.535295 10410 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:43.535533 10410 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:43.535554 10410 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:43.536700 10410 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:43.536738 10410 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:43.536751 10410 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:43.536764 10410 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:43.536777 10410 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:43.538223 10410 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:43953
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:43953
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10410
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:43.538458 10410 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:43.538708 10410 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:43.543783 10418 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.543783 10415 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.543808 10416 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:43.544265 10410 server_base.cc:1034] running on GCE node
I20260928 20:18:43.544495 10410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:43.544765 10410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:43.545940 10410 hybrid_clock.cc:648] HybridClock initialized: now 1790626723545925 us; error 28 us; skew 500 ppm
I20260928 20:18:43.547495 10410 webserver.cc:460] Webserver started at http://127.24.190.62:45723/ using document root <none> and password file <none>
I20260928 20:18:43.547771 10410 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:43.547845 10410 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:43.547997 10410 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:43.549081 10410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "89764f3f7bb50de904133f4eff6c592d"
server_key_iv: "27984037babf558acea6c9418808bf71"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.549444 10410 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "89764f3f7bb50de904133f4eff6c592d"
server_key_iv: "27984037babf558acea6c9418808bf71"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.550835 10410 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:18:43.551709 10424 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.551882 10410 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.551988 10410 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "89764f3f7bb50de904133f4eff6c592d"
server_key_iv: "27984037babf558acea6c9418808bf71"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.552065 10410 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:43.561174 10410 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:43.561466 10410 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:43.561621 10410 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:43.565850 10410 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:43953
I20260928 20:18:43.565876 10476 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:43953 every 8 connection(s)
I20260928 20:18:43.566223 10410 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:43.567234 10477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:43.567530 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10410
I20260928 20:18:43.567648 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:43.567817 25336 external_mini_cluster.cc:1428] Setting key a35c6515519f27c32e391564d5467307
I20260928 20:18:43.569914 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c: Bootstrap starting.
I20260928 20:18:43.570585 10477 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:43.570889 10477 log.cc:824] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:43.571607 10477 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c: No bootstrap required, opened a new log
I20260928 20:18:43.573570 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.568413 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58338 (local address 127.24.190.62:43953)
0928 20:18:43.568603 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.568613 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.568639 (+ 26us) server_negotiation.cc:407] Connection header received
0928 20:18:43.569041 (+ 402us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.569047 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.569206 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.569367 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:43.569549 (+ 182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.570513 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.571418 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.571877 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.572024 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.572930 (+ 906us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:43.572934 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:43.572934 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:43.573106 (+ 172us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:43.573138 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:43.573149 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:43.573242 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.573319 (+ 77us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.573402 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":58,"threads_started":1}
I20260928 20:18:43.573789 10477 raft_consensus.cc:348] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43953 } }
I20260928 20:18:43.573971 10477 raft_consensus.cc:374] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:43.574019 10477 raft_consensus.cc:729] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 311a7abe6ad54cb79bc5ae3dadb9e61c, State: Initialized, Role: FOLLOWER
I20260928 20:18:43.574179 10477 consensus_queue.cc:260] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43953 } }
I20260928 20:18:43.574301 10477 raft_consensus.cc:388] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:43.574354 10477 raft_consensus.cc:482] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:43.574404 10477 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:43.574954 10477 raft_consensus.cc:504] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43953 } }
I20260928 20:18:43.575078 10477 leader_election.cc:302] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 311a7abe6ad54cb79bc5ae3dadb9e61c; no voters:
I20260928 20:18:43.575280 10477 leader_election.cc:288] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:43.575322 10482 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:43.575538 10477 sys_catalog.cc:564] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:43.575625 10482 raft_consensus.cc:686] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [term 1 LEADER]: Becoming Leader. State: Replica: 311a7abe6ad54cb79bc5ae3dadb9e61c, State: Running, Role: LEADER
I20260928 20:18:43.575749 10482 consensus_queue.cc:237] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43953 } }
I20260928 20:18:43.576102 10482 sys_catalog.cc:455] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 311a7abe6ad54cb79bc5ae3dadb9e61c. Latest consensus state: current_term: 1 leader_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43953 } } }
I20260928 20:18:43.576202 10483 sys_catalog.cc:455] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "311a7abe6ad54cb79bc5ae3dadb9e61c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 43953 } } }
I20260928 20:18:43.576246 10482 sys_catalog.cc:458] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:43.576304 10483 sys_catalog.cc:458] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:43.576467 10491 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:43.577020 10491 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:43.578629 10491 catalog_manager.cc:1347] Generated new cluster ID: 90cf0bdf106048dca8004834e8d258c7
I20260928 20:18:43.578707 10491 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:43.584523 10491 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:43.585064 10491 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:43.588866 10491 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c: Generated new TSK 0
I20260928 20:18:43.589044 10491 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:43.595630 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43953
--builtin_ntp_servers=127.24.190.20:46483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:43.679006 10501 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:43.679265 10501 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:43.679306 10501 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:43.680528 10501 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:43.680598 10501 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:43.680644 10501 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:43.682046 10501 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10501
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:43.682374 10501 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:43.682682 10501 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:43.687891 10506 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.687970 10507 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.687894 10509 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:43.688262 10501 server_base.cc:1034] running on GCE node
I20260928 20:18:43.688463 10501 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:43.688735 10501 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:43.689899 10501 hybrid_clock.cc:648] HybridClock initialized: now 1790626723689879 us; error 37 us; skew 500 ppm
I20260928 20:18:43.691547 10501 webserver.cc:460] Webserver started at http://127.24.190.1:43211/ using document root <none> and password file <none>
I20260928 20:18:43.691838 10501 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:43.691890 10501 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:43.692034 10501 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:43.693228 10501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "eb6a0e60400946d79b89d8978e6d856c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "c7ecdb89676d5e63ae0eda1245e58f22"
server_key_iv: "e4fce6566cd98fc2977896bd7f903a99"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.693617 10501 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "eb6a0e60400946d79b89d8978e6d856c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "c7ecdb89676d5e63ae0eda1245e58f22"
server_key_iv: "e4fce6566cd98fc2977896bd7f903a99"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.695091 10501 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:18:43.695900 10515 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.696058 10501 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:18:43.696164 10501 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "eb6a0e60400946d79b89d8978e6d856c"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "c7ecdb89676d5e63ae0eda1245e58f22"
server_key_iv: "e4fce6566cd98fc2977896bd7f903a99"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.696249 10501 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:43.716760 10501 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:43.717103 10501 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:43.717227 10501 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:43.717514 10501 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:43.717860 10501 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:43.717916 10501 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.717959 10501 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:43.717985 10501 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.724570 10501 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:42811
I20260928 20:18:43.724689 10628 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:42811 every 8 connection(s)
I20260928 20:18:43.724993 10501 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:43.730587 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.725791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:37265 (local address 127.24.190.62:43953)
0928 20:18:43.725842 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.725844 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.726048 (+ 204us) server_negotiation.cc:407] Connection header received
0928 20:18:43.726651 (+ 603us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.726652 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.726667 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.726734 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:43.727401 (+ 667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.727952 (+ 551us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.728965 (+ 1013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.729223 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.729292 (+ 69us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.730075 (+ 783us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:43.730076 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:43.730076 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:43.730081 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:43.730096 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:43.730099 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:43.730246 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.730494 (+ 248us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.730525 (+ 31us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:18:43.730662 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.725720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43953 (local address 127.24.190.1:37265)
0928 20:18:43.725905 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.725948 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.726539 (+ 591us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.726806 (+ 267us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.726809 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.726817 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:43.727319 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.727323 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.728048 (+ 725us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.728049 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.728857 (+ 808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.728859 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.729312 (+ 453us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.729313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.729420 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.729930 (+ 510us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:43.729930 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:43.729958 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:43.729980 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:43.730263 (+ 283us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:43.730317 (+ 54us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:43.730320 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.730396 (+ 76us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.730476 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":120,"thread_start_us":91,"threads_started":1}
I20260928 20:18:43.731145 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10501
I20260928 20:18:43.731207 10629 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43953
I20260928 20:18:43.731268 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:18:43.731324 10629 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:43.731467 25336 external_mini_cluster.cc:1428] Setting key edc6f1a34d4774498424f0386fcfa508
I20260928 20:18:43.731508 10629 heartbeater.cc:511] Master 127.24.190.62:43953 requested a full tablet report, sending...
I20260928 20:18:43.732128 10440 ts_manager.cc:194] Registered new tserver with Master: eb6a0e60400946d79b89d8978e6d856c (127.24.190.1:42811)
I20260928 20:18:43.732461 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43953
--builtin_ntp_servers=127.24.190.20:46483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260928 20:18:43.732870 10440 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.1:37265
W20260928 20:18:43.816505 10632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:43.816713 10632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:43.816735 10632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:43.817924 10632 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:43.817970 10632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:43.817996 10632 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:43.819458 10632 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10632
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:43.819721 10632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:43.820034 10632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:43.825558 10637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.825592 10640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.825594 10638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:43.825868 10632 server_base.cc:1034] running on GCE node
I20260928 20:18:43.826098 10632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:43.826417 10632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:43.827610 10632 hybrid_clock.cc:648] HybridClock initialized: now 1790626723827606 us; error 42 us; skew 500 ppm
I20260928 20:18:43.829144 10632 webserver.cc:460] Webserver started at http://127.24.190.2:41651/ using document root <none> and password file <none>
I20260928 20:18:43.829463 10632 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:43.829547 10632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:43.829730 10632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:43.830976 10632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "fa3a080de9d944248a40257c8fd90e0d"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "45c64710341ff1b8be72f460a1035aed"
server_key_iv: "f113ff73e454a82b177e67e7bb503b2e"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.831354 10632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "fa3a080de9d944248a40257c8fd90e0d"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "45c64710341ff1b8be72f460a1035aed"
server_key_iv: "f113ff73e454a82b177e67e7bb503b2e"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.832800 10632 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:18:43.833751 10646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.833978 10632 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:43.834087 10632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "fa3a080de9d944248a40257c8fd90e0d"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "45c64710341ff1b8be72f460a1035aed"
server_key_iv: "f113ff73e454a82b177e67e7bb503b2e"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.834178 10632 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:43.860323 10632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:43.860710 10632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:43.860888 10632 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:43.861159 10632 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:43.861537 10632 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:43.861605 10632 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.861641 10632 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:43.861668 10632 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.867862 10632 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:41349
I20260928 20:18:43.867903 10759 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:41349 every 8 connection(s)
I20260928 20:18:43.868287 10632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:18:43.873608 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.869140 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:38677 (local address 127.24.190.62:43953)
0928 20:18:43.869213 (+ 73us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.869214 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.869474 (+ 260us) server_negotiation.cc:407] Connection header received
0928 20:18:43.869995 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.869996 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.870006 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.870068 (+ 62us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:43.870789 (+ 721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.871284 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.872302 (+ 1018us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.872483 (+ 181us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.872538 (+ 55us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.873378 (+ 840us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:43.873379 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:43.873379 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:43.873384 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:43.873405 (+ 21us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:43.873408 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:43.873456 (+ 48us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:43.873522 (+ 66us) server_negotiation.cc:299] Negotiation successful
0928 20:18:43.873547 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 20:18:43.873891 10762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.869142 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43953 (local address 127.24.190.2:38677)
0928 20:18:43.869338 (+ 196us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.869382 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.869904 (+ 522us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.870133 (+ 229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.870136 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.870145 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:43.870710 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.870716 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.871365 (+ 649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.871366 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.872216 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:43.872219 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:43.872561 (+ 342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:43.872562 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:43.872715 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:43.873238 (+ 523us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:43.873239 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:43.873268 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:43.873291 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:43.873456 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:43.873458 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:43.873461 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:43.873509 (+ 48us) client_negotiation.cc:240] Negotiation successful
0928 20:18:43.873587 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":89,"threads_started":1}
I20260928 20:18:43.874450 10760 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43953
I20260928 20:18:43.874547 10760 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:43.874748 10760 heartbeater.cc:511] Master 127.24.190.62:43953 requested a full tablet report, sending...
I20260928 20:18:43.875133 10440 ts_manager.cc:194] Registered new tserver with Master: fa3a080de9d944248a40257c8fd90e0d (127.24.190.2:41349)
I20260928 20:18:43.875519 10440 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.2:38677
I20260928 20:18:43.877962 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10632
I20260928 20:18:43.878057 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:18:43.878208 25336 external_mini_cluster.cc:1428] Setting key 6fec6d3a1e35db929458de4a8b2970c7
I20260928 20:18:43.879400 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43953
--builtin_ntp_servers=127.24.190.20:46483
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:43.961261 10763 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:43.961465 10763 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:43.961488 10763 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:43.962574 10763 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:43.962610 10763 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:43.962635 10763 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:43.963909 10763 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46483
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:43953
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10763
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:43.964141 10763 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:43.964458 10763 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:43.969738 10768 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.969761 10771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:43.969940 10769 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:43.969972 10763 server_base.cc:1034] running on GCE node
I20260928 20:18:43.970227 10763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:43.970525 10763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:43.971688 10763 hybrid_clock.cc:648] HybridClock initialized: now 1790626723971673 us; error 25 us; skew 500 ppm
I20260928 20:18:43.973299 10763 webserver.cc:460] Webserver started at http://127.24.190.3:37731/ using document root <none> and password file <none>
I20260928 20:18:43.973575 10763 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:43.973628 10763 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:43.973795 10763 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:43.975099 10763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "16a01fe6be9f4ccdacf3f58760eac908"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "91733a4e234d820bec4c20f71f3ae39d"
server_key_iv: "a4b990d683a6705c764bbccdddf32e3d"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.975518 10763 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "16a01fe6be9f4ccdacf3f58760eac908"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "91733a4e234d820bec4c20f71f3ae39d"
server_key_iv: "a4b990d683a6705c764bbccdddf32e3d"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.977269 10763 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260928 20:18:43.978173 10777 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.978426 10763 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:43.978547 10763 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "16a01fe6be9f4ccdacf3f58760eac908"
format_stamp: "Formatted at 2026-09-28 20:18:43 on dist-test-slave-n45k"
server_key: "91733a4e234d820bec4c20f71f3ae39d"
server_key_iv: "a4b990d683a6705c764bbccdddf32e3d"
server_key_version: "encryptionkey@0"
I20260928 20:18:43.978642 10763 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:43.990767 10763 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:43.991087 10763 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:43.991236 10763 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:43.991466 10763 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:43.991801 10763 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:43.991858 10763 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.991900 10763 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:43.991926 10763 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:43.997643 10763 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:37013
I20260928 20:18:43.997682 10890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:37013 every 8 connection(s)
I20260928 20:18:43.998010 10763 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:18:44.003635 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.998837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48785 (local address 127.24.190.62:43953)
0928 20:18:43.998903 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:43.998906 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:43.999187 (+ 281us) server_negotiation.cc:407] Connection header received
0928 20:18:43.999758 (+ 571us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:43.999759 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:43.999770 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:43.999827 (+ 57us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:44.000500 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.001023 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.002138 (+ 1115us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.002380 (+ 242us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.002436 (+ 56us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.003403 (+ 967us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:44.003405 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:44.003405 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:44.003410 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:44.003424 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:44.003428 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:44.003475 (+ 47us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.003545 (+ 70us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.003569 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 20:18:44.003892 10893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:43.998824 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:43953 (local address 127.24.190.3:48785)
0928 20:18:43.999045 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:43.999079 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:43.999603 (+ 524us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:43.999915 (+ 312us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:43.999919 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:43.999933 (+ 14us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:44.000428 (+ 495us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.000432 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.001144 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.001145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.002039 (+ 894us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.002041 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.002457 (+ 416us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.002458 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.002579 (+ 121us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.003250 (+ 671us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:44.003251 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:44.003281 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:44.003312 (+ 31us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:44.003477 (+ 165us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:44.003480 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:44.003483 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:44.003533 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:18:44.003613 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":115,"threads_started":1}
I20260928 20:18:44.004455 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10763
I20260928 20:18:44.004585 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:18:44.004603 10891 heartbeater.cc:347] Connected to a master server at 127.24.190.62:43953
I20260928 20:18:44.004693 10891 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:44.004835 25336 external_mini_cluster.cc:1428] Setting key bb5910640967a821c6660add3510c9b7
I20260928 20:18:44.004908 10891 heartbeater.cc:511] Master 127.24.190.62:43953 requested a full tablet report, sending...
I20260928 20:18:44.005503 10440 ts_manager.cc:194] Registered new tserver with Master: 16a01fe6be9f4ccdacf3f58760eac908 (127.24.190.3:37013)
I20260928 20:18:44.005978 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:44.006042 10440 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.3:48785
I20260928 20:18:44.010787 10480 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.007766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58340 (local address 127.24.190.62:43953)
0928 20:18:44.007810 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.007812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.008021 (+ 209us) server_negotiation.cc:407] Connection header received
0928 20:18:44.008045 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.008045 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.008055 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.008107 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:44.008281 (+ 174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.008775 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.009567 (+ 792us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.009776 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.009836 (+ 60us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.010596 (+ 760us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:44.010597 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:44.010597 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:44.010601 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:44.010615 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:44.010619 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:44.010673 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.010712 (+ 39us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.010731 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:18:44.012601 10440 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58340:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:44.014346 10440 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:44.021270 10901 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.016847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:37013 (local address 127.0.0.1:46118)
0928 20:18:44.017161 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:44.017191 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:44.017289 (+ 98us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:44.017547 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:44.017550 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:44.017553 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:44.017668 (+ 115us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.017670 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.018876 (+ 1206us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.018878 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.020146 (+ 1268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.020149 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.020911 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.020912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.020990 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.021004 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:18:44.021125 (+ 121us) client_negotiation.cc:240] Negotiation successful
0928 20:18:44.021194 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":280,"mutex_wait_us":1,"thread_start_us":76,"threads_started":1}
I20260928 20:18:44.021282 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.016953 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.24.190.3:37013)
0928 20:18:44.017121 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.017126 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.017264 (+ 138us) server_negotiation.cc:407] Connection header received
0928 20:18:44.017373 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.017375 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.017392 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.017470 (+ 78us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:44.017749 (+ 279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.018760 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.020241 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.020810 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.020900 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.020992 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.021149 (+ 157us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.021191 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":77,"threads_started":1}
I20260928 20:18:44.021373 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.017105 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59592 (local address 127.24.190.1:42811)
0928 20:18:44.017247 (+ 142us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.017250 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.017494 (+ 244us) server_negotiation.cc:407] Connection header received
0928 20:18:44.017543 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.017545 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.017560 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.017663 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:44.017804 (+ 141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.018933 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.020197 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.020877 (+ 680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.020948 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.021047 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.021246 (+ 199us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.021287 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109,"thread_start_us":82,"threads_started":1}
I20260928 20:18:44.021737 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.017350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55258 (local address 127.24.190.2:41349)
0928 20:18:44.017800 (+ 450us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.017805 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.017815 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:18:44.017859 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.017861 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.017875 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.017945 (+ 70us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:44.018116 (+ 171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.019199 (+ 1083us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.020441 (+ 1242us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.021124 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.021188 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.021280 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.021615 (+ 335us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.021659 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":93,"threads_started":1}
I20260928 20:18:44.021529 10899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.016894 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:41349 (local address 127.0.0.1:55258)
0928 20:18:44.017556 (+ 662us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:44.017564 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:44.017598 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:44.017973 (+ 375us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:44.017974 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:44.017976 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:44.018026 (+ 50us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.018028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.019291 (+ 1263us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.019292 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.020352 (+ 1060us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.020354 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.021312 (+ 958us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.021313 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.021370 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.021375 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:44.021424 (+ 49us) client_negotiation.cc:240] Negotiation successful
0928 20:18:44.021463 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":652,"thread_start_us":91,"threads_started":1}
I20260928 20:18:44.021605 10900 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.016847 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:42811 (local address 127.0.0.1:59592)
0928 20:18:44.017426 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:44.017435 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:44.017484 (+ 49us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:44.017663 (+ 179us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:44.017664 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:44.017666 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:44.017711 (+ 45us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.017712 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.019028 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.019029 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.020106 (+ 1077us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.020108 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.021090 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.021091 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.021150 (+ 59us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.021154 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:18:44.021476 (+ 322us) client_negotiation.cc:240] Negotiation successful
0928 20:18:44.021511 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":561,"mutex_wait_us":41,"thread_start_us":77,"threads_started":1}
I20260928 20:18:44.022711 10694 tablet_service.cc:1467] Processing CreateTablet for tablet 22a74d7ebf7a4895b681eb9dea287ffa (DEFAULT_TABLE table=test-table [id=1b26fbe4ed5d459dbaeeb501e6c4f7b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:44.022707 10825 tablet_service.cc:1467] Processing CreateTablet for tablet 22a74d7ebf7a4895b681eb9dea287ffa (DEFAULT_TABLE table=test-table [id=1b26fbe4ed5d459dbaeeb501e6c4f7b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:44.023049 10694 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22a74d7ebf7a4895b681eb9dea287ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:44.023061 10825 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22a74d7ebf7a4895b681eb9dea287ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:44.025519 10905 tablet_bootstrap.cc:492] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Bootstrap starting.
I20260928 20:18:44.026161 10905 tablet_bootstrap.cc:654] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:44.026074 10563 tablet_service.cc:1467] Processing CreateTablet for tablet 22a74d7ebf7a4895b681eb9dea287ffa (DEFAULT_TABLE table=test-table [id=1b26fbe4ed5d459dbaeeb501e6c4f7b0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:44.026427 10563 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22a74d7ebf7a4895b681eb9dea287ffa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:44.026409 10906 tablet_bootstrap.cc:492] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Bootstrap starting.
I20260928 20:18:44.026489 10905 log.cc:824] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:44.027109 10906 tablet_bootstrap.cc:654] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:44.027259 10905 tablet_bootstrap.cc:492] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: No bootstrap required, opened a new log
I20260928 20:18:44.027352 10905 ts_tablet_manager.cc:1397] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:18:44.027451 10906 log.cc:824] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:44.028263 10906 tablet_bootstrap.cc:492] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: No bootstrap required, opened a new log
I20260928 20:18:44.028360 10906 ts_tablet_manager.cc:1397] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:18:44.029460 10905 raft_consensus.cc:348] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.029644 10905 raft_consensus.cc:374] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:44.029693 10905 raft_consensus.cc:729] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16a01fe6be9f4ccdacf3f58760eac908, State: Initialized, Role: FOLLOWER
I20260928 20:18:44.029829 10905 consensus_queue.cc:260] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.030100 10909 tablet_bootstrap.cc:492] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c: Bootstrap starting.
I20260928 20:18:44.030128 10905 ts_tablet_manager.cc:1428] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260928 20:18:44.030319 10891 heartbeater.cc:503] Master 127.24.190.62:43953 was elected leader, sending a full tablet report...
I20260928 20:18:44.030829 10909 tablet_bootstrap.cc:654] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:44.031013 10906 raft_consensus.cc:348] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.031180 10906 raft_consensus.cc:374] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:44.031178 10909 log.cc:824] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:44.031219 10906 raft_consensus.cc:729] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa3a080de9d944248a40257c8fd90e0d, State: Initialized, Role: FOLLOWER
I20260928 20:18:44.031347 10906 consensus_queue.cc:260] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.031615 10906 ts_tablet_manager.cc:1428] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260928 20:18:44.031632 10760 heartbeater.cc:503] Master 127.24.190.62:43953 was elected leader, sending a full tablet report...
I20260928 20:18:44.031946 10909 tablet_bootstrap.cc:492] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c: No bootstrap required, opened a new log
I20260928 20:18:44.032012 10909 ts_tablet_manager.cc:1397] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s
I20260928 20:18:44.033850 10909 raft_consensus.cc:348] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.034003 10909 raft_consensus.cc:374] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:44.034052 10909 raft_consensus.cc:729] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb6a0e60400946d79b89d8978e6d856c, State: Initialized, Role: FOLLOWER
I20260928 20:18:44.034165 10909 consensus_queue.cc:260] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.034461 10909 ts_tablet_manager.cc:1428] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c: Time spent starting tablet: real 0.002s user 0.000s sys 0.003s
I20260928 20:18:44.034511 10629 heartbeater.cc:503] Master 127.24.190.62:43953 was elected leader, sending a full tablet report...
W20260928 20:18:44.118901 10761 tablet.cc:2369] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:44.194723 10913 raft_consensus.cc:482] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:44.194854 10913 raft_consensus.cc:504] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.195305 10913 leader_election.cc:288] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 16a01fe6be9f4ccdacf3f58760eac908 (127.24.190.3:37013), fa3a080de9d944248a40257c8fd90e0d (127.24.190.2:41349)
I20260928 20:18:44.198165 10631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.195504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:41349 (local address 127.24.190.1:42269)
0928 20:18:44.195554 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:44.195568 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:44.195619 (+ 51us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:44.195852 (+ 233us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:44.195853 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:44.195855 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:44.195928 (+ 73us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.195930 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.196589 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.196590 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.197350 (+ 760us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.197352 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.197904 (+ 552us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.197906 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.197980 (+ 74us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.197982 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:18:44.198048 (+ 66us) client_negotiation.cc:240] Negotiation successful
0928 20:18:44.198092 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":29}
I20260928 20:18:44.198166 10904 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.195615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:42269 (local address 127.24.190.2:41349)
0928 20:18:44.195680 (+ 65us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.195683 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.195694 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:18:44.195726 (+ 32us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.195727 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.195736 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.195797 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:44.195990 (+ 193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.196493 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.197449 (+ 956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.197815 (+ 366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.197904 (+ 89us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.197913 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.198072 (+ 159us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.198107 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:18:44.198406 10914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.195547 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:37013 (local address 127.24.190.1:39889)
0928 20:18:44.195739 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:44.195747 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:44.195872 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:44.196042 (+ 170us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:44.196043 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:44.196045 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:44.196122 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.196124 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.196743 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.196745 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.197510 (+ 765us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:44.197513 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.198085 (+ 572us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.198086 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:44.198168 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.198170 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:18:44.198242 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:18:44.198284 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":179,"thread_start_us":140,"threads_started":1}
I20260928 20:18:44.198611 10714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a74d7ebf7a4895b681eb9dea287ffa" candidate_uuid: "eb6a0e60400946d79b89d8978e6d856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa3a080de9d944248a40257c8fd90e0d" is_pre_election: true
I20260928 20:18:44.198701 10902 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.195597 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:39889 (local address 127.24.190.3:37013)
0928 20:18:44.195642 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.195645 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.195848 (+ 203us) server_negotiation.cc:407] Connection header received
0928 20:18:44.195959 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.195960 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.195967 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.196036 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:44.196211 (+ 175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.196663 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.197636 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.197988 (+ 352us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.198082 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.198089 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.198620 (+ 531us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.198655 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
I20260928 20:18:44.198812 10714 raft_consensus.cc:2454] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb6a0e60400946d79b89d8978e6d856c in term 0.
I20260928 20:18:44.198982 10845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a74d7ebf7a4895b681eb9dea287ffa" candidate_uuid: "eb6a0e60400946d79b89d8978e6d856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16a01fe6be9f4ccdacf3f58760eac908" is_pre_election: true
I20260928 20:18:44.199064 10518 leader_election.cc:302] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: eb6a0e60400946d79b89d8978e6d856c, fa3a080de9d944248a40257c8fd90e0d; no voters:
I20260928 20:18:44.199159 10845 raft_consensus.cc:2454] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb6a0e60400946d79b89d8978e6d856c in term 0.
I20260928 20:18:44.199190 10913 raft_consensus.cc:2781] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:44.199261 10913 raft_consensus.cc:482] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:44.199288 10913 raft_consensus.cc:3037] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:44.199996 10913 raft_consensus.cc:504] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.200165 10913 leader_election.cc:288] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [CANDIDATE]: Term 1 election: Requested vote from peers 16a01fe6be9f4ccdacf3f58760eac908 (127.24.190.3:37013), fa3a080de9d944248a40257c8fd90e0d (127.24.190.2:41349)
I20260928 20:18:44.200327 10845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a74d7ebf7a4895b681eb9dea287ffa" candidate_uuid: "eb6a0e60400946d79b89d8978e6d856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "16a01fe6be9f4ccdacf3f58760eac908"
I20260928 20:18:44.200342 10714 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22a74d7ebf7a4895b681eb9dea287ffa" candidate_uuid: "eb6a0e60400946d79b89d8978e6d856c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa3a080de9d944248a40257c8fd90e0d"
I20260928 20:18:44.200398 10845 raft_consensus.cc:3037] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:44.200440 10714 raft_consensus.cc:3037] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:44.201042 10845 raft_consensus.cc:2454] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb6a0e60400946d79b89d8978e6d856c in term 1.
I20260928 20:18:44.201237 10517 leader_election.cc:302] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16a01fe6be9f4ccdacf3f58760eac908, eb6a0e60400946d79b89d8978e6d856c; no voters:
I20260928 20:18:44.201334 10913 raft_consensus.cc:2781] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:44.201383 10714 raft_consensus.cc:2454] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb6a0e60400946d79b89d8978e6d856c in term 1.
I20260928 20:18:44.201437 10913 raft_consensus.cc:686] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [term 1 LEADER]: Becoming Leader. State: Replica: eb6a0e60400946d79b89d8978e6d856c, State: Running, Role: LEADER
I20260928 20:18:44.201546 10913 consensus_queue.cc:237] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } }
I20260928 20:18:44.202463 10440 catalog_manager.cc:5495] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c reported cstate change: term changed from 0 to 1, leader changed from <none> to eb6a0e60400946d79b89d8978e6d856c (127.24.190.1). New cstate: current_term: 1 leader_uuid: "eb6a0e60400946d79b89d8978e6d856c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb6a0e60400946d79b89d8978e6d856c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 42811 } health_report { overall_health: HEALTHY } } }
I20260928 20:18:44.209111 10903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.206634 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59600 (local address 127.24.190.1:42811)
0928 20:18:44.206673 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:44.206675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:44.206688 (+ 13us) server_negotiation.cc:407] Connection header received
0928 20:18:44.206748 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:44.206749 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:44.206773 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:44.206836 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:44.206919 (+ 83us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.207431 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.208420 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:44.208623 (+ 203us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:44.208684 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:44.208826 (+ 142us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:44.208917 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:44.208981 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:44.209027 (+ 46us) server_negotiation.cc:299] Negotiation successful
0928 20:18:44.209044 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:18:44.210925 10714 raft_consensus.cc:1261] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 1 FOLLOWER]: Refusing update from remote peer eb6a0e60400946d79b89d8978e6d856c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:44.210939 10845 raft_consensus.cc:1261] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 1 FOLLOWER]: Refusing update from remote peer eb6a0e60400946d79b89d8978e6d856c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:44.211282 10915 consensus_queue.cc:1035] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [LEADER]: Connected to new peer: Peer: permanent_uuid: "16a01fe6be9f4ccdacf3f58760eac908" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 37013 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:44.211416 10913 consensus_queue.cc:1035] T 22a74d7ebf7a4895b681eb9dea287ffa P eb6a0e60400946d79b89d8978e6d856c [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa3a080de9d944248a40257c8fd90e0d" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 41349 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:44.214192 10918 mvcc.cc:205] Tried to move back new op lower bound from 7334407062365483008 to 7334407062330118144. Current Snapshot: MvccSnapshot[applied={T|T < 7334407062365483008}]
I20260928 20:18:44.214331 10919 mvcc.cc:205] Tried to move back new op lower bound from 7334407062365483008 to 7334407062330118144. Current Snapshot: MvccSnapshot[applied={T|T < 7334407062365483008}]
I20260928 20:18:44.214500 10920 mvcc.cc:205] Tried to move back new op lower bound from 7334407062365483008 to 7334407062330118144. Current Snapshot: MvccSnapshot[applied={T|T < 7334407062365483008}]
I20260928 20:18:44.216833 10440 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:58340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:44.216926 10440 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:58340:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:44.217666 10440 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 311a7abe6ad54cb79bc5ae3dadb9e61c: Sending DeleteTablet for 3 replicas of tablet 22a74d7ebf7a4895b681eb9dea287ffa
I20260928 20:18:44.218048 10694 tablet_service.cc:1514] Processing DeleteTablet for tablet 22a74d7ebf7a4895b681eb9dea287ffa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:44 UTC) from {username='slave'} at 127.0.0.1:55258
I20260928 20:18:44.218293 10928 tablet_replica.cc:330] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: stopping tablet replica
I20260928 20:18:44.218302 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10501
I20260928 20:18:44.218297 10825 tablet_service.cc:1514] Processing DeleteTablet for tablet 22a74d7ebf7a4895b681eb9dea287ffa with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:44 UTC) from {username='slave'} at 127.0.0.1:46118
I20260928 20:18:44.218474 10928 raft_consensus.cc:2229] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:44.218608 10928 raft_consensus.cc:2258] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:44.219503 10929 tablet_replica.cc:330] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: stopping tablet replica
I20260928 20:18:44.219621 10929 raft_consensus.cc:2229] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:44.219722 10929 raft_consensus.cc:2258] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:44.220467 10929 ts_tablet_manager.cc:1905] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:44.220705 10928 ts_tablet_manager.cc:1905] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:44.222889 10929 ts_tablet_manager.cc:1918] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:44.222970 10929 log.cc:1196] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/22a74d7ebf7a4895b681eb9dea287ffa
I20260928 20:18:44.223037 10928 ts_tablet_manager.cc:1918] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:44.223161 10929 ts_tablet_manager.cc:1939] T 22a74d7ebf7a4895b681eb9dea287ffa P 16a01fe6be9f4ccdacf3f58760eac908: Deleting consensus metadata
I20260928 20:18:44.223165 10928 log.cc:1196] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/22a74d7ebf7a4895b681eb9dea287ffa
I20260928 20:18:44.223495 10928 ts_tablet_manager.cc:1939] T 22a74d7ebf7a4895b681eb9dea287ffa P fa3a080de9d944248a40257c8fd90e0d: Deleting consensus metadata
I20260928 20:18:44.223529 10426 catalog_manager.cc:4841] TS 16a01fe6be9f4ccdacf3f58760eac908 (127.24.190.3:37013): tablet 22a74d7ebf7a4895b681eb9dea287ffa (table test-table [id=1b26fbe4ed5d459dbaeeb501e6c4f7b0]) successfully deleted
I20260928 20:18:44.223975 10427 catalog_manager.cc:4841] TS fa3a080de9d944248a40257c8fd90e0d (127.24.190.2:41349): tablet 22a74d7ebf7a4895b681eb9dea287ffa (table test-table [id=1b26fbe4ed5d459dbaeeb501e6c4f7b0]) successfully deleted
W20260928 20:18:44.224819 10425 connection.cc:535] client connection to 127.24.190.1:42811 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260928 20:18:44.224923 10425 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260928 20:18:44.225353 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10632
I20260928 20:18:44.225438 10899 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:44.225309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:42811 (local address 127.0.0.1:59602)
0928 20:18:44.225365 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:44.225411 (+ 46us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:42811: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260928 20:18:44.226574 10425 catalog_manager.cc:4584] TS eb6a0e60400946d79b89d8978e6d856c (127.24.190.1:42811): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 22a74d7ebf7a4895b681eb9dea287ffa: Network error: Client connection negotiation failed: client connection to 127.24.190.1:42811: connect: Connection refused (error 111)
I20260928 20:18:44.230108 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10763
I20260928 20:18:44.234656 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10410
2026-09-28T20:18:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (809 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:44 dist-test-slave-n45k krb5kdc[10933](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:44 dist-test-slave-n45k krb5kdc[10933](info): set up 2 sockets
Sep 28 20:18:44 dist-test-slave-n45k krb5kdc[10933](info): commencing operation
krb5kdc: starting...
W20260928 20:18:45.290560 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.005s sys 0.000s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:45Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:45Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:18:45.410243 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:45073
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:45073
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:45.492189 10946 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:45.492412 10946 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:45.492434 10946 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:45.493541 10946 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:45.493587 10946 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:45.493602 10946 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:45.493613 10946 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:45.493625 10946 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:45.495179 10946 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:45073
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:45073
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.10946
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:45.495391 10946 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:45.495566 10946 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:45.500582 10952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:45.500726 10946 server_base.cc:1034] running on GCE node
W20260928 20:18:45.500589 10951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:45.500607 10954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:45.501157 10946 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:45.501477 10946 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:45.502671 10946 hybrid_clock.cc:648] HybridClock initialized: now 1790626725502649 us; error 53 us; skew 500 ppm
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:45.505425 10946 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:18:45.505894 10946 webserver.cc:460] Webserver started at http://127.24.190.62:46761/ using document root <none> and password file <none>
I20260928 20:18:45.506136 10946 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:45.506217 10946 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:45.506388 10946 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:45.507467 10946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "91cf747538b74e0b8a03581188d1f1b5"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "d9be10be24d9ca1e831306ec9f8be22d"
server_key_iv: "791701a5b86a689704583b776c0d1ad8"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.507835 10946 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "91cf747538b74e0b8a03581188d1f1b5"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "d9be10be24d9ca1e831306ec9f8be22d"
server_key_iv: "791701a5b86a689704583b776c0d1ad8"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.509146 10946 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:45.509884 10961 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.510069 10946 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:18:45.510175 10946 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "91cf747538b74e0b8a03581188d1f1b5"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "d9be10be24d9ca1e831306ec9f8be22d"
server_key_iv: "791701a5b86a689704583b776c0d1ad8"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.510262 10946 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:45.530870 10946 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:45.533326 10946 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:45.533507 10946 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:45.537564 10946 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:45073
I20260928 20:18:45.537603 11013 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:45073 every 8 connection(s)
I20260928 20:18:45.537979 10946 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:45.538929 11014 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:45.541162 11014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: Bootstrap starting.
I20260928 20:18:45.541692 11014 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:45.541925 11014 log.cc:824] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:45.542719 11014 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: No bootstrap required, opened a new log
I20260928 20:18:45.544615 11014 raft_consensus.cc:348] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cf747538b74e0b8a03581188d1f1b5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45073 } }
I20260928 20:18:45.544765 11014 raft_consensus.cc:374] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:45.544798 11014 raft_consensus.cc:729] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91cf747538b74e0b8a03581188d1f1b5, State: Initialized, Role: FOLLOWER
I20260928 20:18:45.544974 11014 consensus_queue.cc:260] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cf747538b74e0b8a03581188d1f1b5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45073 } }
I20260928 20:18:45.545064 11014 raft_consensus.cc:388] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:45.545089 11014 raft_consensus.cc:482] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:45.545118 11014 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:45.545543 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 10946
I20260928 20:18:45.545680 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:45.545701 11014 raft_consensus.cc:504] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cf747538b74e0b8a03581188d1f1b5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45073 } }
I20260928 20:18:45.545836 11014 leader_election.cc:302] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 91cf747538b74e0b8a03581188d1f1b5; no voters:
I20260928 20:18:45.545890 25336 external_mini_cluster.cc:1428] Setting key f3943a940ef3e034a9392cc6b5a1c807
I20260928 20:18:45.546029 11014 leader_election.cc:288] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:45.546051 11017 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:45.546167 11017 raft_consensus.cc:686] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [term 1 LEADER]: Becoming Leader. State: Replica: 91cf747538b74e0b8a03581188d1f1b5, State: Running, Role: LEADER
I20260928 20:18:45.546254 11017 consensus_queue.cc:237] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cf747538b74e0b8a03581188d1f1b5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45073 } }
I20260928 20:18:45.546572 11014 sys_catalog.cc:564] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:45.546723 11018 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 91cf747538b74e0b8a03581188d1f1b5. Latest consensus state: current_term: 1 leader_uuid: "91cf747538b74e0b8a03581188d1f1b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cf747538b74e0b8a03581188d1f1b5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45073 } } }
I20260928 20:18:45.546857 11019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "91cf747538b74e0b8a03581188d1f1b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "91cf747538b74e0b8a03581188d1f1b5" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 45073 } } }
I20260928 20:18:45.546914 11019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:45.546892 11018 sys_catalog.cc:458] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5 [sys.catalog]: This master's current role is: LEADER
W20260928 20:18:45.548573 11034 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:18:45.548630 11034 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:18:45.548694 11023 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:45.548836 11023 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:45.550500 11023 catalog_manager.cc:1347] Generated new cluster ID: d13bdd380aca4fe39e0c371651349caa
I20260928 20:18:45.550556 11023 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:45.558728 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:45.546418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53798 (local address 127.24.190.62:45073)
0928 20:18:45.546746 (+ 328us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:45.546759 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:45.547041 (+ 282us) server_negotiation.cc:407] Connection header received
0928 20:18:45.547182 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:45.547190 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:45.547256 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:45.547413 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:45.548229 (+ 816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.549316 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.550456 (+ 1140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.551037 (+ 581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.551147 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:45.554095 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:45.554100 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:45.554101 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:45.554114 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:45.556917 (+ 2803us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:45.557322 (+ 405us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:45.557326 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:45.557326 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:45.557450 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:45.557656 (+ 206us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:45.557657 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:45.557658 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:45.558004 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:45.558171 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:45.558293 (+ 122us) server_negotiation.cc:299] Negotiation successful
0928 20:18:45.558483 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":275,"thread_start_us":73,"threads_started":1}
I20260928 20:18:45.560503 11023 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:45.561008 11023 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:45.564136 11023 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: Generated new TSK 0
I20260928 20:18:45.564314 11023 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:18:45.593580 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45073
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:45.676159 11040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:45.676374 11040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:45.676397 11040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:45.677560 11040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:45.677608 11040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:45.677645 11040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:45.679140 11040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11040
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:45.679391 11040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:45.679625 11040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:45.684782 11048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:45.684790 11046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:45.684913 11040 server_base.cc:1034] running on GCE node
W20260928 20:18:45.684792 11045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:45.685321 11040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:45.685520 11040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:45.686666 11040 hybrid_clock.cc:648] HybridClock initialized: now 1790626725686652 us; error 28 us; skew 500 ppm
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:45.689327 11040 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:18:45.689824 11040 webserver.cc:460] Webserver started at http://127.24.190.1:34797/ using document root <none> and password file <none>
I20260928 20:18:45.690073 11040 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:45.690153 11040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:45.690357 11040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:45.691418 11040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "fddc281720f24b76b066d274df0d335c"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "dffecfda1e117ccce4f2cd9a026d5af1"
server_key_iv: "4cdabdc3153aae4361b8ac8b352a8e89"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.691787 11040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "fddc281720f24b76b066d274df0d335c"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "dffecfda1e117ccce4f2cd9a026d5af1"
server_key_iv: "4cdabdc3153aae4361b8ac8b352a8e89"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.693198 11040 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:45.693990 11055 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.694248 11040 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:45.694379 11040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "fddc281720f24b76b066d274df0d335c"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "dffecfda1e117ccce4f2cd9a026d5af1"
server_key_iv: "4cdabdc3153aae4361b8ac8b352a8e89"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.694468 11040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:45.728024 11040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:45.730213 11040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:45.730417 11040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:45.730674 11040 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:45.731014 11040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:45.731074 11040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.731115 11040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:45.731137 11040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.736954 11040 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:35447
I20260928 20:18:45.736999 11168 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:35447 every 8 connection(s)
I20260928 20:18:45.737326 11040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:45.738837 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11040
I20260928 20:18:45.738950 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:18:45.739176 25336 external_mini_cluster.cc:1428] Setting key f5d4e5f0343b56e6ced8e7b0284770db
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
I20260928 20:18:45.748535 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:45.738123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:48881 (local address 127.24.190.62:45073)
0928 20:18:45.738202 (+ 79us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:45.738203 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:45.738456 (+ 253us) server_negotiation.cc:407] Connection header received
0928 20:18:45.739140 (+ 684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:45.739141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:45.739154 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:45.739206 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:45.740430 (+ 1224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.741078 (+ 648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.742139 (+ 1061us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.742512 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.742578 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:45.745086 (+ 2508us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:45.745088 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:45.745088 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:45.745097 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:45.746843 (+ 1746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:45.747386 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:45.747389 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:45.747390 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:45.747452 (+ 62us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:45.747781 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:45.747782 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:45.747783 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:45.747940 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:45.748023 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:45.748401 (+ 378us) server_negotiation.cc:299] Negotiation successful
0928 20:18:45.748469 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260928 20:18:45.748791 11171 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:45.738080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:45073 (local address 127.24.190.1:48881)
0928 20:18:45.738330 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:45.738371 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:45.739024 (+ 653us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:45.739301 (+ 277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:45.739306 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:45.739998 (+ 692us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:45.740307 (+ 309us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:45.740314 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.741213 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.741215 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:45.742047 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:45.742050 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.742603 (+ 553us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.742604 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:45.742719 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:45.743265 (+ 546us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:45.743273 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:45.744985 (+ 1712us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:45.746986 (+ 2001us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:45.746993 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:45.746995 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:45.747303 (+ 308us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:45.747536 (+ 233us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:45.747536 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:45.747537 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:45.747715 (+ 178us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:45.748050 (+ 335us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:45.748058 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:45.748249 (+ 191us) client_negotiation.cc:769] Sending connection context
0928 20:18:45.748366 (+ 117us) client_negotiation.cc:240] Negotiation successful
0928 20:18:45.748501 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":206,"thread_start_us":87,"threads_started":1}
I20260928 20:18:45.749540 11169 heartbeater.cc:347] Connected to a master server at 127.24.190.62:45073
I20260928 20:18:45.749631 11169 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:45.749821 11169 heartbeater.cc:511] Master 127.24.190.62:45073 requested a full tablet report, sending...
I20260928 20:18:45.750470 10978 ts_manager.cc:194] Registered new tserver with Master: fddc281720f24b76b066d274df0d335c (127.24.190.1:35447)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
I20260928 20:18:45.751272 10978 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:48881
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:18:45.765265 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45073
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:45.848445 11174 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:45.848667 11174 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:45.848694 11174 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:45.849982 11174 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:45.850029 11174 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:45.850059 11174 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:45.851667 11174 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11174
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:45.851949 11174 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:45.852227 11174 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:45.857535 11182 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:45.857748 11174 server_base.cc:1034] running on GCE node
W20260928 20:18:45.857728 11179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:45.857535 11180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:45.858129 11174 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:45.858446 11174 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:45.859681 11174 hybrid_clock.cc:648] HybridClock initialized: now 1790626725859673 us; error 57 us; skew 500 ppm
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:45.862479 11174 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:18:45.862955 11174 webserver.cc:460] Webserver started at http://127.24.190.2:39979/ using document root <none> and password file <none>
I20260928 20:18:45.863207 11174 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:45.863277 11174 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:45.863420 11174 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:45.864471 11174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "b780a3de2ebb47b38c330c5c9abdf618"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "005831f44471642665572311e8bc9061"
server_key_iv: "9c3f238bff5fdcd04a2c5d0ea2c89f9f"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.864835 11174 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "b780a3de2ebb47b38c330c5c9abdf618"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "005831f44471642665572311e8bc9061"
server_key_iv: "9c3f238bff5fdcd04a2c5d0ea2c89f9f"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.866384 11174 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.002s
I20260928 20:18:45.867316 11189 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.867539 11174 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:45.867650 11174 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "b780a3de2ebb47b38c330c5c9abdf618"
format_stamp: "Formatted at 2026-09-28 20:18:45 on dist-test-slave-n45k"
server_key: "005831f44471642665572311e8bc9061"
server_key_iv: "9c3f238bff5fdcd04a2c5d0ea2c89f9f"
server_key_version: "encryptionkey@0"
I20260928 20:18:45.867738 11174 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:45.892349 11174 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:45.894493 11174 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:45.894682 11174 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:45.894939 11174 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:45.895253 11174 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:45.895313 11174 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.895354 11174 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:45.895375 11174 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:45.901391 11174 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:37739
I20260928 20:18:45.901448 11302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:37739 every 8 connection(s)
I20260928 20:18:45.901823 11174 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:18:45 dist-test-slave-n45k krb5kdc[10933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626725, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:45.910624 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11174
I20260928 20:18:45.910745 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:18:45.910933 25336 external_mini_cluster.cc:1428] Setting key 2a721bde6e5b4e0c4f7d093bc296ba4b
I20260928 20:18:45.912470 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:45.902699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:59759 (local address 127.24.190.62:45073)
0928 20:18:45.902803 (+ 104us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:45.902806 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:45.902991 (+ 185us) server_negotiation.cc:407] Connection header received
0928 20:18:45.903501 (+ 510us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:45.903502 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:45.903513 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:45.903587 (+ 74us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:45.904560 (+ 973us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.905060 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.906335 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.906544 (+ 209us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.906605 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:45.908939 (+ 2334us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:45.908940 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:45.908940 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:45.908947 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:45.910627 (+ 1680us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:45.911268 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:45.911270 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:45.911270 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:45.911334 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:45.911710 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:45.911711 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:45.911712 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:45.911863 (+ 151us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:45.911955 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:45.912229 (+ 274us) server_negotiation.cc:299] Negotiation successful
0928 20:18:45.912328 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260928 20:18:45.912648 11305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:45.902667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:45073 (local address 127.24.190.2:59759)
0928 20:18:45.902856 (+ 189us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:45.902893 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:45.903364 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:45.903647 (+ 283us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:45.903650 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:45.904227 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:45.904422 (+ 195us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:45.904428 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.905236 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.905237 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:45.906173 (+ 936us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:45.906175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:45.906646 (+ 471us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:45.906648 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:45.906758 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:45.907260 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:45.907269 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:45.908847 (+ 1578us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:45.910759 (+ 1912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:45.910766 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:45.910769 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:45.911096 (+ 327us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:45.911414 (+ 318us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:45.911415 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:45.911416 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:45.911563 (+ 147us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:45.911941 (+ 378us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:45.911946 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:45.912066 (+ 120us) client_negotiation.cc:769] Sending connection context
0928 20:18:45.912166 (+ 100us) client_negotiation.cc:240] Negotiation successful
0928 20:18:45.912372 (+ 206us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":152,"thread_start_us":121,"threads_started":1}
I20260928 20:18:45.913429 11303 heartbeater.cc:347] Connected to a master server at 127.24.190.62:45073
I20260928 20:18:45.913546 11303 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:45.913780 11303 heartbeater.cc:511] Master 127.24.190.62:45073 requested a full tablet report, sending...
I20260928 20:18:45.914242 10978 ts_manager.cc:194] Registered new tserver with Master: b780a3de2ebb47b38c330c5c9abdf618 (127.24.190.2:37739)
I20260928 20:18:45.914743 10978 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:59759
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:18:45.937793 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45073
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:45369
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:46.019672 11308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:46.019876 11308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:46.019901 11308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:46.021077 11308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:46.021126 11308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:46.021152 11308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:46.022662 11308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:45369
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:45073
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11308
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:46.022902 11308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:46.023135 11308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:46.028491 11313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.028486 11316 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.028728 11314 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:46.028785 11308 server_base.cc:1034] running on GCE node
I20260928 20:18:46.028983 11308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:46.029167 11308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:46.030381 11308 hybrid_clock.cc:648] HybridClock initialized: now 1790626726030361 us; error 26 us; skew 500 ppm
Sep 28 20:18:46 dist-test-slave-n45k krb5kdc[10933](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626726, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:46.033154 11308 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:18:46.033638 11308 webserver.cc:460] Webserver started at http://127.24.190.3:38549/ using document root <none> and password file <none>
I20260928 20:18:46.033871 11308 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:46.033937 11308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:46.034085 11308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:46.035280 11308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "240327cb30540d6ecbf2ea8868b815af"
server_key_iv: "f17e150ccd63481a5009ead4a0c3cf3c"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.035655 11308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "240327cb30540d6ecbf2ea8868b815af"
server_key_iv: "f17e150ccd63481a5009ead4a0c3cf3c"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.036986 11308 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:18:46.037734 11323 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.037935 11308 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:18:46.038026 11308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "240327cb30540d6ecbf2ea8868b815af"
server_key_iv: "f17e150ccd63481a5009ead4a0c3cf3c"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.038115 11308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:46.055572 11308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:46.057960 11308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:46.058132 11308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:46.058471 11308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:46.058888 11308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:46.058940 11308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.058977 11308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:46.058996 11308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.065135 11308 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:38453
I20260928 20:18:46.065177 11436 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:38453 every 8 connection(s)
I20260928 20:18:46.065492 11308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:18:46 dist-test-slave-n45k krb5kdc[10933](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626726, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:46.072593 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11308
I20260928 20:18:46.072719 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:18:46.072938 25336 external_mini_cluster.cc:1428] Setting key 0e290de11a7e2744e1d8c0a242923f85
I20260928 20:18:46.075738 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.066362 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48121 (local address 127.24.190.62:45073)
0928 20:18:46.066431 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.066433 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.066575 (+ 142us) server_negotiation.cc:407] Connection header received
0928 20:18:46.067238 (+ 663us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.067239 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.067249 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.067316 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:46.068467 (+ 1151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.068963 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.070053 (+ 1090us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.070254 (+ 201us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.070395 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.072672 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:46.072674 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:46.072674 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:46.072683 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:46.074420 (+ 1737us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:46.074802 (+ 382us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:46.074803 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:46.074803 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:46.074857 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:46.075081 (+ 224us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:46.075082 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:46.075082 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:46.075208 (+ 126us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:46.075271 (+ 63us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.075591 (+ 320us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.075673 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":39}
I20260928 20:18:46.076022 11439 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.066258 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:45073 (local address 127.24.190.3:48121)
0928 20:18:46.066428 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.066469 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.066958 (+ 489us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.067420 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.067423 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.068034 (+ 611us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:46.068351 (+ 317us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.068356 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.069057 (+ 701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.069058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.069964 (+ 906us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.069967 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.070413 (+ 446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.070414 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.070551 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.071087 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:46.071096 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:46.072567 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:46.074486 (+ 1919us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:46.074492 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:46.074494 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:46.074732 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:46.074911 (+ 179us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:46.074911 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:46.074912 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:46.074996 (+ 84us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:46.075320 (+ 324us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:46.075326 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:46.075451 (+ 125us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.075554 (+ 103us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.075729 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":126,"thread_start_us":100,"threads_started":1}
I20260928 20:18:46.076612 11437 heartbeater.cc:347] Connected to a master server at 127.24.190.62:45073
I20260928 20:18:46.076710 11437 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:46.076915 11437 heartbeater.cc:511] Master 127.24.190.62:45073 requested a full tablet report, sending...
I20260928 20:18:46.077342 10978 ts_manager.cc:194] Registered new tserver with Master: ecd8976331bb4ba9a4e0e14e6c8859d5 (127.24.190.3:38453)
I20260928 20:18:46.077723 10978 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:48121
I20260928 20:18:46.085150 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:46.093300 11021 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.086549 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53812 (local address 127.24.190.62:45073)
0928 20:18:46.086598 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.086600 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.086757 (+ 157us) server_negotiation.cc:407] Connection header received
0928 20:18:46.086839 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.086840 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.086850 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.086906 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:46.087466 (+ 560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.087969 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.088780 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.088976 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.089063 (+ 87us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.090472 (+ 1409us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:46.090474 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:46.090474 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:46.090482 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:46.091994 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:46.092425 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:46.092426 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:46.092427 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:46.092495 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:46.092727 (+ 232us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:46.092729 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:46.092729 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:46.092872 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:46.092991 (+ 119us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.093131 (+ 140us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.093201 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:18:46.095117 10978 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53812:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:46.096726 10978 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:46.103487 11448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.099391 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38453 (local address 127.0.0.1:58952)
0928 20:18:46.099999 (+ 608us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.100008 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.100061 (+ 53us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.100320 (+ 259us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.100321 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.100323 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:46.100358 (+ 35us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.100359 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.101541 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.101542 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.102543 (+ 1001us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.102545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.103206 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.103207 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.103269 (+ 62us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.103279 (+ 10us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.103342 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.103412 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":89,"threads_started":1}
I20260928 20:18:46.103494 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.099498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58952 (local address 127.24.190.3:38453)
0928 20:18:46.099663 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.099669 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.100132 (+ 463us) server_negotiation.cc:407] Connection header received
0928 20:18:46.100175 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.100178 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.100194 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.100257 (+ 63us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:46.100427 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.101433 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.102629 (+ 1196us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.103109 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.103205 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.103263 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.103376 (+ 113us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.103414 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":87,"threads_started":1}
I20260928 20:18:46.103528 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.099335 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37256 (local address 127.24.190.1:35447)
0928 20:18:46.099702 (+ 367us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.099706 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.099715 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:46.099757 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.099759 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.099770 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.099948 (+ 178us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:46.100218 (+ 270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.100911 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.102241 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.102993 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.103069 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.103126 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.103396 (+ 270us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.103438 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":332,"thread_start_us":76,"threads_started":1}
I20260928 20:18:46.103848 11453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.099556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39622 (local address 127.24.190.2:37739)
0928 20:18:46.099756 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.099759 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.099767 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:18:46.099802 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.099804 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.099815 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.099913 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:46.100104 (+ 191us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.101220 (+ 1116us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.102579 (+ 1359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.103312 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.103682 (+ 370us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.103738 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.103760 (+ 22us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.103794 (+ 34us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169,"thread_start_us":83,"threads_started":1}
I20260928 20:18:46.103600 11449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.099176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:37739 (local address 127.0.0.1:39622)
0928 20:18:46.099375 (+ 199us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.099416 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.099479 (+ 63us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.099919 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.099923 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.099925 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:46.099993 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.099995 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.101332 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.101333 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.102480 (+ 1147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.102482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.103403 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.103404 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.103456 (+ 52us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.103459 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.103488 (+ 29us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.103524 (+ 36us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":164,"mutex_wait_us":55,"thread_start_us":72,"threads_started":1}
I20260928 20:18:46.104000 11451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.099228 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:35447 (local address 127.0.0.1:37256)
0928 20:18:46.099521 (+ 293us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.099532 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.099586 (+ 54us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.100079 (+ 493us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.100080 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.100082 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:46.100137 (+ 55us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.100138 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.101017 (+ 879us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.101018 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.102155 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.102158 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.103166 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.103167 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.103260 (+ 93us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.103274 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.103347 (+ 73us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.103921 (+ 574us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":272,"mutex_wait_us":529,"thread_start_us":93,"threads_started":1}
I20260928 20:18:46.104876 11237 tablet_service.cc:1467] Processing CreateTablet for tablet 53173f516b014317a083b53f347a52dc (DEFAULT_TABLE table=test-table [id=e63936b210624fe38b9474416541a1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:46.104876 11371 tablet_service.cc:1467] Processing CreateTablet for tablet 53173f516b014317a083b53f347a52dc (DEFAULT_TABLE table=test-table [id=e63936b210624fe38b9474416541a1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:46.105230 11237 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53173f516b014317a083b53f347a52dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:46.105230 11371 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53173f516b014317a083b53f347a52dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:46.106719 11103 tablet_service.cc:1467] Processing CreateTablet for tablet 53173f516b014317a083b53f347a52dc (DEFAULT_TABLE table=test-table [id=e63936b210624fe38b9474416541a1ce]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:46.107092 11103 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53173f516b014317a083b53f347a52dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:46.108631 11454 tablet_bootstrap.cc:492] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Bootstrap starting.
I20260928 20:18:46.109316 11454 tablet_bootstrap.cc:654] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:46.109972 11454 log.cc:824] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:46.110222 11456 tablet_bootstrap.cc:492] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: Bootstrap starting.
I20260928 20:18:46.110352 11455 tablet_bootstrap.cc:492] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Bootstrap starting.
I20260928 20:18:46.110924 11454 tablet_bootstrap.cc:492] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: No bootstrap required, opened a new log
I20260928 20:18:46.110940 11456 tablet_bootstrap.cc:654] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:46.111016 11454 ts_tablet_manager.cc:1397] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:18:46.111104 11455 tablet_bootstrap.cc:654] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:46.111547 11455 log.cc:824] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:46.111515 11456 log.cc:824] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:46.112444 11455 tablet_bootstrap.cc:492] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: No bootstrap required, opened a new log
I20260928 20:18:46.112471 11456 tablet_bootstrap.cc:492] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: No bootstrap required, opened a new log
I20260928 20:18:46.112519 11455 ts_tablet_manager.cc:1397] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:18:46.112528 11456 ts_tablet_manager.cc:1397] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:18:46.113515 11454 raft_consensus.cc:348] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.113708 11454 raft_consensus.cc:374] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:46.113746 11454 raft_consensus.cc:729] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b780a3de2ebb47b38c330c5c9abdf618, State: Initialized, Role: FOLLOWER
I20260928 20:18:46.113900 11454 consensus_queue.cc:260] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.114200 11454 ts_tablet_manager.cc:1428] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:18:46.114231 11303 heartbeater.cc:503] Master 127.24.190.62:45073 was elected leader, sending a full tablet report...
I20260928 20:18:46.114528 11456 raft_consensus.cc:348] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.114717 11456 raft_consensus.cc:374] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:46.114758 11456 raft_consensus.cc:729] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddc281720f24b76b066d274df0d335c, State: Initialized, Role: FOLLOWER
I20260928 20:18:46.114645 11455 raft_consensus.cc:348] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.114854 11455 raft_consensus.cc:374] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:46.114858 11456 consensus_queue.cc:260] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.114897 11455 raft_consensus.cc:729] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecd8976331bb4ba9a4e0e14e6c8859d5, State: Initialized, Role: FOLLOWER
I20260928 20:18:46.115036 11455 consensus_queue.cc:260] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.115110 11456 ts_tablet_manager.cc:1428] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:18:46.115262 11169 heartbeater.cc:503] Master 127.24.190.62:45073 was elected leader, sending a full tablet report...
I20260928 20:18:46.115370 11437 heartbeater.cc:503] Master 127.24.190.62:45073 was elected leader, sending a full tablet report...
I20260928 20:18:46.115387 11455 ts_tablet_manager.cc:1428] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
W20260928 20:18:46.152428 11304 tablet.cc:2369] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:18:46.238118 11170 tablet.cc:2369] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:46.275754 11460 raft_consensus.cc:482] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:46.275882 11460 raft_consensus.cc:504] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.276327 11460 leader_election.cc:288] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecd8976331bb4ba9a4e0e14e6c8859d5 (127.24.190.3:38453), fddc281720f24b76b066d274df0d335c (127.24.190.1:35447)
I20260928 20:18:46.280395 11450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.276615 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:36379 (local address 127.24.190.1:35447)
0928 20:18:46.276663 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.276665 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.276894 (+ 229us) server_negotiation.cc:407] Connection header received
0928 20:18:46.276925 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.276926 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.276933 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.276971 (+ 38us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:46.277234 (+ 263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.277918 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.279403 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.279975 (+ 572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.280058 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.280078 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.280271 (+ 193us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.280325 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:18:46.280396 11463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.276529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:35447 (local address 127.24.190.2:36379)
0928 20:18:46.276777 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.276785 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.276854 (+ 69us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.277000 (+ 146us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.277001 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.277003 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:46.277063 (+ 60us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.277064 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.278028 (+ 964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.278028 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.279298 (+ 1270us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.279301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.280093 (+ 792us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.280094 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.280181 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.280186 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.280253 (+ 67us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.280306 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":226,"mutex_wait_us":32,"thread_start_us":134,"threads_started":1}
I20260928 20:18:46.280459 11452 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.276643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:44815 (local address 127.24.190.3:38453)
0928 20:18:46.276709 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.276711 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.276726 (+ 15us) server_negotiation.cc:407] Connection header received
0928 20:18:46.276752 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.276752 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.276759 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.276820 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:46.277030 (+ 210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.277803 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.279404 (+ 1601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.279975 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.280058 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.280078 (+ 20us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.280350 (+ 272us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.280389 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260928 20:18:46.280484 11305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.276529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:38453 (local address 127.24.190.2:44815)
0928 20:18:46.276620 (+ 91us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.276634 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.276681 (+ 47us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.276850 (+ 169us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.276851 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.276853 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:46.276931 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.276933 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.277911 (+ 978us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.277912 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.279298 (+ 1386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.279301 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.280190 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.280191 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.280273 (+ 82us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.280275 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.280324 (+ 49us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.280357 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":70,"mutex_wait_us":3}
I20260928 20:18:46.280844 11391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53173f516b014317a083b53f347a52dc" candidate_uuid: "b780a3de2ebb47b38c330c5c9abdf618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" is_pre_election: true
I20260928 20:18:46.280936 11123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53173f516b014317a083b53f347a52dc" candidate_uuid: "b780a3de2ebb47b38c330c5c9abdf618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddc281720f24b76b066d274df0d335c" is_pre_election: true
I20260928 20:18:46.281042 11391 raft_consensus.cc:2454] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b780a3de2ebb47b38c330c5c9abdf618 in term 0.
I20260928 20:18:46.281054 11123 raft_consensus.cc:2454] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b780a3de2ebb47b38c330c5c9abdf618 in term 0.
I20260928 20:18:46.281313 11190 leader_election.cc:302] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b780a3de2ebb47b38c330c5c9abdf618, fddc281720f24b76b066d274df0d335c; no voters:
I20260928 20:18:46.281472 11460 raft_consensus.cc:2781] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:46.281558 11460 raft_consensus.cc:482] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:46.281586 11460 raft_consensus.cc:3037] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:46.282487 11460 raft_consensus.cc:504] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.282627 11460 leader_election.cc:288] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [CANDIDATE]: Term 1 election: Requested vote from peers ecd8976331bb4ba9a4e0e14e6c8859d5 (127.24.190.3:38453), fddc281720f24b76b066d274df0d335c (127.24.190.1:35447)
I20260928 20:18:46.282795 11391 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53173f516b014317a083b53f347a52dc" candidate_uuid: "b780a3de2ebb47b38c330c5c9abdf618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5"
I20260928 20:18:46.282799 11123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53173f516b014317a083b53f347a52dc" candidate_uuid: "b780a3de2ebb47b38c330c5c9abdf618" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddc281720f24b76b066d274df0d335c"
I20260928 20:18:46.282886 11391 raft_consensus.cc:3037] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:46.282876 11123 raft_consensus.cc:3037] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:46.283568 11123 raft_consensus.cc:2454] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b780a3de2ebb47b38c330c5c9abdf618 in term 1.
I20260928 20:18:46.283573 11391 raft_consensus.cc:2454] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b780a3de2ebb47b38c330c5c9abdf618 in term 1.
I20260928 20:18:46.283795 11190 leader_election.cc:302] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b780a3de2ebb47b38c330c5c9abdf618, fddc281720f24b76b066d274df0d335c; no voters:
I20260928 20:18:46.283910 11460 raft_consensus.cc:2781] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:46.284047 11460 raft_consensus.cc:686] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 1 LEADER]: Becoming Leader. State: Replica: b780a3de2ebb47b38c330c5c9abdf618, State: Running, Role: LEADER
I20260928 20:18:46.284147 11460 consensus_queue.cc:237] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } }
I20260928 20:18:46.285015 10977 catalog_manager.cc:5495] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 reported cstate change: term changed from 0 to 1, leader changed from <none> to b780a3de2ebb47b38c330c5c9abdf618 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "b780a3de2ebb47b38c330c5c9abdf618" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b780a3de2ebb47b38c330c5c9abdf618" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 37739 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 } health_report { overall_health: UNKNOWN } } }
W20260928 20:18:46.316079 11438 tablet.cc:2369] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:46.332015 11453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.329462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39634 (local address 127.24.190.2:37739)
0928 20:18:46.329546 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.329548 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.329557 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:46.329600 (+ 43us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.329601 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.329619 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.329684 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:46.329838 (+ 154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.330346 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.331187 (+ 841us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.331379 (+ 192us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.331440 (+ 61us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.331620 (+ 180us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:46.331719 (+ 99us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:46.331797 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.331847 (+ 50us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.331857 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260928 20:18:46.333966 11391 raft_consensus.cc:1261] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 1 FOLLOWER]: Refusing update from remote peer b780a3de2ebb47b38c330c5c9abdf618: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:46.334061 11123 raft_consensus.cc:1261] T 53173f516b014317a083b53f347a52dc P fddc281720f24b76b066d274df0d335c [term 1 FOLLOWER]: Refusing update from remote peer b780a3de2ebb47b38c330c5c9abdf618: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:46.334385 11460 consensus_queue.cc:1035] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecd8976331bb4ba9a4e0e14e6c8859d5" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 38453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:46.334559 11464 consensus_queue.cc:1035] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddc281720f24b76b066d274df0d335c" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 35447 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:46.338253 11468 mvcc.cc:205] Tried to move back new op lower bound from 7334407071061049344 to 7334407070860468224. Current Snapshot: MvccSnapshot[applied={T|T < 7334407071061049344 or (T in {7334407071061049344})}]
I20260928 20:18:46.339808 10976 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:46.339918 10976 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53812:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:46.340687 10976 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 91cf747538b74e0b8a03581188d1f1b5: Sending DeleteTablet for 3 replicas of tablet 53173f516b014317a083b53f347a52dc
I20260928 20:18:46.341042 11103 tablet_service.cc:1514] Processing DeleteTablet for tablet 53173f516b014317a083b53f347a52dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:46 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:37256
I20260928 20:18:46.341054 11237 tablet_service.cc:1514] Processing DeleteTablet for tablet 53173f516b014317a083b53f347a52dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:46 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:39622
I20260928 20:18:46.341121 11371 tablet_service.cc:1514] Processing DeleteTablet for tablet 53173f516b014317a083b53f347a52dc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:46 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:58952
I20260928 20:18:46.341272 11476 tablet_replica.cc:330] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: stopping tablet replica
I20260928 20:18:46.341392 11476 raft_consensus.cc:2229] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:18:46.341491 11476 raft_consensus.cc:2258] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:46.341580 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11040
I20260928 20:18:46.342608 11476 ts_tablet_manager.cc:1905] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:46.343711 11478 tablet_replica.cc:330] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: stopping tablet replica
I20260928 20:18:46.343871 11478 raft_consensus.cc:2229] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:46.344023 11478 raft_consensus.cc:2258] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:46.344352 11476 ts_tablet_manager.cc:1918] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:46.344636 11478 ts_tablet_manager.cc:1905] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:46.345975 11476 log.cc:1196] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/53173f516b014317a083b53f347a52dc
I20260928 20:18:46.346366 11476 ts_tablet_manager.cc:1939] T 53173f516b014317a083b53f347a52dc P b780a3de2ebb47b38c330c5c9abdf618: Deleting consensus metadata
I20260928 20:18:46.346926 10965 catalog_manager.cc:4841] TS b780a3de2ebb47b38c330c5c9abdf618 (127.24.190.2:37739): tablet 53173f516b014317a083b53f347a52dc (table test-table [id=e63936b210624fe38b9474416541a1ce]) successfully deleted
I20260928 20:18:46.347631 11478 ts_tablet_manager.cc:1918] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:46.347744 11478 log.cc:1196] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/53173f516b014317a083b53f347a52dc
I20260928 20:18:46.348037 11478 ts_tablet_manager.cc:1939] T 53173f516b014317a083b53f347a52dc P ecd8976331bb4ba9a4e0e14e6c8859d5: Deleting consensus metadata
I20260928 20:18:46.348501 10965 catalog_manager.cc:4841] TS ecd8976331bb4ba9a4e0e14e6c8859d5 (127.24.190.3:38453): tablet 53173f516b014317a083b53f347a52dc (table test-table [id=e63936b210624fe38b9474416541a1ce]) successfully deleted
W20260928 20:18:46.348811 10962 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:35447 (error 108)
I20260928 20:18:46.349102 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11174
I20260928 20:18:46.350009 11451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.349888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:35447 (local address 127.0.0.1:37268)
0928 20:18:46.349935 (+ 47us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.349968 (+ 33us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:35447: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260928 20:18:46.350126 10962 catalog_manager.cc:4584] TS fddc281720f24b76b066d274df0d335c (127.24.190.1:35447): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 53173f516b014317a083b53f347a52dc: Network error: Client connection negotiation failed: client connection to 127.24.190.1:35447: connect: Connection refused (error 111)
I20260928 20:18:46.353515 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11308
I20260928 20:18:46.358071 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 10946
2026-09-28T20:18:46Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (2123 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-09-28T20:18:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:46Z Disabled control of system clock
I20260928 20:18:46.386170 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:34761
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:34761
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:46.467615 11483 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:46.467835 11483 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:46.467856 11483 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:46.469049 11483 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:46.469099 11483 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:46.469112 11483 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:46.469125 11483 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:46.469138 11483 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:46.470611 11483 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:34761
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:34761
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11483
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:46.470863 11483 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:46.471184 11483 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:46.476222 11488 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.476257 11489 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.476317 11491 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:46.476866 11483 server_base.cc:1034] running on GCE node
I20260928 20:18:46.477227 11483 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:46.477509 11483 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:46.478663 11483 hybrid_clock.cc:648] HybridClock initialized: now 1790626726478634 us; error 37 us; skew 500 ppm
I20260928 20:18:46.485394 11483 webserver.cc:460] Webserver started at http://127.24.190.62:33839/ using document root <none> and password file <none>
I20260928 20:18:46.485704 11483 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:46.485757 11483 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:46.485948 11483 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:46.487251 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "32f885ff287c45158e46dc301541cc1b"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "8a39323ec9550d20d4efdacfdc92d7a0"
server_key_iv: "6aeb287ad25b4eb70a6dc7585159f5b4"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.487627 11483 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "32f885ff287c45158e46dc301541cc1b"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "8a39323ec9550d20d4efdacfdc92d7a0"
server_key_iv: "6aeb287ad25b4eb70a6dc7585159f5b4"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.488981 11483 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:18:46.490077 11497 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.490427 11483 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:46.490542 11483 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "32f885ff287c45158e46dc301541cc1b"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "8a39323ec9550d20d4efdacfdc92d7a0"
server_key_iv: "6aeb287ad25b4eb70a6dc7585159f5b4"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.490620 11483 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:46.501899 11483 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:46.502218 11483 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:46.502395 11483 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:46.506070 11483 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:34761
I20260928 20:18:46.506124 11549 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:34761 every 8 connection(s)
I20260928 20:18:46.506624 11483 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:46.507604 11550 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:46.509887 11550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b: Bootstrap starting.
I20260928 20:18:46.510524 11550 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:46.510840 11550 log.cc:824] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:46.510864 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11483
I20260928 20:18:46.510969 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:46.511168 25336 external_mini_cluster.cc:1428] Setting key a0131814e37f270afec5f0e5f6b8fd8a
I20260928 20:18:46.511642 11550 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b: No bootstrap required, opened a new log
I20260928 20:18:46.513355 11550 raft_consensus.cc:348] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32f885ff287c45158e46dc301541cc1b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34761 } }
I20260928 20:18:46.513603 11550 raft_consensus.cc:374] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:46.513686 11550 raft_consensus.cc:729] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 32f885ff287c45158e46dc301541cc1b, State: Initialized, Role: FOLLOWER
I20260928 20:18:46.513844 11550 consensus_queue.cc:260] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32f885ff287c45158e46dc301541cc1b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34761 } }
I20260928 20:18:46.513942 11550 raft_consensus.cc:388] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:46.513988 11550 raft_consensus.cc:482] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:46.514037 11550 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:46.514647 11550 raft_consensus.cc:504] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32f885ff287c45158e46dc301541cc1b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34761 } }
I20260928 20:18:46.514768 11550 leader_election.cc:302] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 32f885ff287c45158e46dc301541cc1b; no voters:
I20260928 20:18:46.514963 11550 leader_election.cc:288] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:46.514997 11555 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:46.515185 11555 raft_consensus.cc:686] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [term 1 LEADER]: Becoming Leader. State: Replica: 32f885ff287c45158e46dc301541cc1b, State: Running, Role: LEADER
I20260928 20:18:46.515256 11550 sys_catalog.cc:564] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:46.515311 11555 consensus_queue.cc:237] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32f885ff287c45158e46dc301541cc1b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34761 } }
I20260928 20:18:46.515702 11555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 32f885ff287c45158e46dc301541cc1b. Latest consensus state: current_term: 1 leader_uuid: "32f885ff287c45158e46dc301541cc1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32f885ff287c45158e46dc301541cc1b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34761 } } }
I20260928 20:18:46.515784 11555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:46.515858 11557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "32f885ff287c45158e46dc301541cc1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "32f885ff287c45158e46dc301541cc1b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 34761 } } }
I20260928 20:18:46.516069 11564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:46.516088 11557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:46.516606 11564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:46.518736 11564 catalog_manager.cc:1347] Generated new cluster ID: ec96eb0945674b2f8b20876067e90344
I20260928 20:18:46.518790 11564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:46.519366 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.511666 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56520 (local address 127.24.190.62:34761)
0928 20:18:46.511856 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.511865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.511896 (+ 31us) server_negotiation.cc:407] Connection header received
0928 20:18:46.513332 (+ 1436us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.513338 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.513396 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.513567 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:46.513848 (+ 281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.515582 (+ 1734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.516849 (+ 1267us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.517502 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.517623 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.518608 (+ 985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:46.518612 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:46.518613 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:46.518824 (+ 211us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:46.518874 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:46.518889 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:46.518959 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.519056 (+ 97us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.519134 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
I20260928 20:18:46.540184 11564 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:46.540741 11564 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:46.546200 11564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b: Generated new TSK 0
I20260928 20:18:46.546427 11564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:46.556533 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34761
--builtin_ntp_servers=127.24.190.20:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:46.639145 11574 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:46.639355 11574 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:46.639379 11574 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:46.640563 11574 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:46.640606 11574 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:46.640637 11574 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:46.642102 11574 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11574
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:46.642390 11574 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:46.642725 11574 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:46.648113 11580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.648106 11579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:46.648263 11574 server_base.cc:1034] running on GCE node
W20260928 20:18:46.648155 11582 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:46.648588 11574 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:46.648801 11574 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:46.649972 11574 hybrid_clock.cc:648] HybridClock initialized: now 1790626726649965 us; error 35 us; skew 500 ppm
I20260928 20:18:46.651595 11574 webserver.cc:460] Webserver started at http://127.24.190.1:43453/ using document root <none> and password file <none>
I20260928 20:18:46.651899 11574 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:46.651964 11574 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:46.652103 11574 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:46.653595 11574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "ef49386b7bdd4405bd4e49198a1e8de6"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "3766339f2d286fad9535e985167c6cfc"
server_key_iv: "9b2602ba92a356039693ccdfa514c2fd"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.654032 11574 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "ef49386b7bdd4405bd4e49198a1e8de6"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "3766339f2d286fad9535e985167c6cfc"
server_key_iv: "9b2602ba92a356039693ccdfa514c2fd"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.660635 11574 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.000s
I20260928 20:18:46.661726 11588 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.661966 11574 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:46.662066 11574 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "ef49386b7bdd4405bd4e49198a1e8de6"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "3766339f2d286fad9535e985167c6cfc"
server_key_iv: "9b2602ba92a356039693ccdfa514c2fd"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.662159 11574 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:46.705030 11574 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:46.705385 11574 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:46.705542 11574 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:46.705803 11574 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:46.706157 11574 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:46.706192 11574 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.706239 11574 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:46.706295 11574 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.712405 11574 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:44631
I20260928 20:18:46.712456 11701 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:44631 every 8 connection(s)
I20260928 20:18:46.712849 11574 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:46.718909 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.713805 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:40423 (local address 127.24.190.62:34761)
0928 20:18:46.713905 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.713908 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.714219 (+ 311us) server_negotiation.cc:407] Connection header received
0928 20:18:46.714894 (+ 675us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.714895 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.714908 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.714961 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:46.715752 (+ 791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.716353 (+ 601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.717502 (+ 1149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.717691 (+ 189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.717745 (+ 54us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.718669 (+ 924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:46.718670 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:46.718670 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:46.718676 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:46.718690 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:46.718694 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:46.718738 (+ 44us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.718826 (+ 88us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.718849 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:18:46.719110 11704 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.713752 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34761 (local address 127.24.190.1:40423)
0928 20:18:46.713992 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.714040 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.714795 (+ 755us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.715021 (+ 226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.715024 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.715033 (+ 9us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:46.715651 (+ 618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.715656 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.716481 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.716482 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.717424 (+ 942us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.717426 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.717775 (+ 349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.717776 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.717899 (+ 123us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.718540 (+ 641us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:46.718541 (+ 1us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:46.718569 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:46.718591 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:46.718752 (+ 161us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:46.718756 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:46.718759 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.718812 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.718889 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":163,"thread_start_us":107,"threads_started":1}
I20260928 20:18:46.719728 11702 heartbeater.cc:347] Connected to a master server at 127.24.190.62:34761
I20260928 20:18:46.719839 11702 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:46.720016 11702 heartbeater.cc:511] Master 127.24.190.62:34761 requested a full tablet report, sending...
I20260928 20:18:46.720579 11514 ts_manager.cc:194] Registered new tserver with Master: ef49386b7bdd4405bd4e49198a1e8de6 (127.24.190.1:44631)
I20260928 20:18:46.721197 11514 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.1:40423
I20260928 20:18:46.721985 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11574
I20260928 20:18:46.722069 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:18:46.722201 25336 external_mini_cluster.cc:1428] Setting key 1d4c19b507024587bf1fc3af3c5646d6
I20260928 20:18:46.723088 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34761
--builtin_ntp_servers=127.24.190.20:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:46.810714 11705 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:46.810921 11705 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:46.810943 11705 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:46.812036 11705 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:46.812072 11705 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:46.812096 11705 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:46.813395 11705 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11705
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:46.813585 11705 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:46.813823 11705 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:46.819831 11710 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.819854 11711 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.819839 11713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:46.820022 11705 server_base.cc:1034] running on GCE node
I20260928 20:18:46.820333 11705 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:46.820526 11705 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:46.821688 11705 hybrid_clock.cc:648] HybridClock initialized: now 1790626726821673 us; error 29 us; skew 500 ppm
I20260928 20:18:46.823117 11705 webserver.cc:460] Webserver started at http://127.24.190.2:35995/ using document root <none> and password file <none>
I20260928 20:18:46.823367 11705 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:46.823417 11705 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:46.823570 11705 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:46.824781 11705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "ac9af8c47e0b4321b0e4913ff94391f7"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "85fe7d68c8f9707b05327c6f39e289d4"
server_key_iv: "52a5a99205af258de2861a2281aecea0"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.825151 11705 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "ac9af8c47e0b4321b0e4913ff94391f7"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "85fe7d68c8f9707b05327c6f39e289d4"
server_key_iv: "52a5a99205af258de2861a2281aecea0"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.826531 11705 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:18:46.827348 11719 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.827582 11705 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:46.827700 11705 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "ac9af8c47e0b4321b0e4913ff94391f7"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "85fe7d68c8f9707b05327c6f39e289d4"
server_key_iv: "52a5a99205af258de2861a2281aecea0"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.827780 11705 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:46.851665 11705 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:46.852025 11705 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:46.852191 11705 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:46.852434 11705 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:46.852772 11705 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:46.852830 11705 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.852870 11705 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:46.852897 11705 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.859086 11705 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:39187
I20260928 20:18:46.859262 11832 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:39187 every 8 connection(s)
I20260928 20:18:46.859526 11705 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:18:46.864931 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.860369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:51627 (local address 127.24.190.62:34761)
0928 20:18:46.860440 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.860443 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.860696 (+ 253us) server_negotiation.cc:407] Connection header received
0928 20:18:46.861278 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.861279 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.861292 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.861347 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:46.862015 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.862537 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.863565 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.863751 (+ 186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.863808 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.864672 (+ 864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:46.864673 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:46.864673 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:46.864677 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:46.864691 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:46.864695 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:46.864748 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.864835 (+ 87us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.864870 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":42}
I20260928 20:18:46.865213 11835 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.860377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34761 (local address 127.24.190.2:51627)
0928 20:18:46.860559 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.860592 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.861063 (+ 471us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.861408 (+ 345us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.861411 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.861419 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:46.861908 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.861912 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.862624 (+ 712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.862625 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.863480 (+ 855us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.863482 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.863827 (+ 345us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.863828 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.863932 (+ 104us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.864516 (+ 584us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:46.864516 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:46.864544 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:46.864566 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:46.864760 (+ 194us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:46.864764 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:46.864766 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.864820 (+ 54us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.864898 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":82,"threads_started":1}
I20260928 20:18:46.865761 11833 heartbeater.cc:347] Connected to a master server at 127.24.190.62:34761
I20260928 20:18:46.865854 11833 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:46.866050 11833 heartbeater.cc:511] Master 127.24.190.62:34761 requested a full tablet report, sending...
I20260928 20:18:46.866571 11514 ts_manager.cc:194] Registered new tserver with Master: ac9af8c47e0b4321b0e4913ff94391f7 (127.24.190.2:39187)
I20260928 20:18:46.866998 11514 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.2:51627
I20260928 20:18:46.868244 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11705
I20260928 20:18:46.868331 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:18:46.868549 25336 external_mini_cluster.cc:1428] Setting key afd45742e2d35a512f18564513c8a3fe
I20260928 20:18:46.869513 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34761
--builtin_ntp_servers=127.24.190.20:37587
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:46.949669 11836 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:46.949930 11836 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:46.949967 11836 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:46.951131 11836 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:46.951207 11836 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:46.951249 11836 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:46.952613 11836 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37587
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:34761
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.11836
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:46.952888 11836 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:46.953178 11836 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:46.958194 11844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.958375 11841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:46.958217 11842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:46.958402 11836 server_base.cc:1034] running on GCE node
I20260928 20:18:46.958645 11836 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:46.958896 11836 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:46.960152 11836 hybrid_clock.cc:648] HybridClock initialized: now 1790626726960045 us; error 35 us; skew 500 ppm
I20260928 20:18:46.961400 11836 webserver.cc:460] Webserver started at http://127.24.190.3:43571/ using document root <none> and password file <none>
I20260928 20:18:46.961691 11836 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:46.961773 11836 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:46.961928 11836 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:46.963160 11836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "d9463185627b46ca8f10f95f1dd87583"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "219161c099c012a8c1c7bf245117b97f"
server_key_iv: "68d0e164044b5ad7db6edcc793541b08"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.963537 11836 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "d9463185627b46ca8f10f95f1dd87583"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "219161c099c012a8c1c7bf245117b97f"
server_key_iv: "68d0e164044b5ad7db6edcc793541b08"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.964946 11836 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:18:46.965838 11850 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.966060 11836 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:46.966315 11836 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "d9463185627b46ca8f10f95f1dd87583"
format_stamp: "Formatted at 2026-09-28 20:18:46 on dist-test-slave-n45k"
server_key: "219161c099c012a8c1c7bf245117b97f"
server_key_iv: "68d0e164044b5ad7db6edcc793541b08"
server_key_version: "encryptionkey@0"
I20260928 20:18:46.966413 11836 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:46.982200 11836 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:46.982545 11836 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:46.982708 11836 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:46.982954 11836 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:46.983328 11836 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:46.983395 11836 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.983438 11836 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:46.983485 11836 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:46.989240 11836 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:46059
I20260928 20:18:46.989313 11963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:46059 every 8 connection(s)
I20260928 20:18:46.989652 11836 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:18:46.994495 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 11836
I20260928 20:18:46.994683 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:18:46.994915 25336 external_mini_cluster.cc:1428] Setting key 0bbb4beab3ea3882ebed950e7b3d9355
I20260928 20:18:46.995502 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.990632 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:33363 (local address 127.24.190.62:34761)
0928 20:18:46.990719 (+ 87us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:46.990721 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:46.990856 (+ 135us) server_negotiation.cc:407] Connection header received
0928 20:18:46.991323 (+ 467us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:46.991324 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:46.991333 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:46.991382 (+ 49us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:46.992039 (+ 657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.992638 (+ 599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.993695 (+ 1057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.993902 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.993959 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.995178 (+ 1219us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:46.995179 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:46.995179 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:46.995185 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:46.995198 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:46.995202 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:46.995245 (+ 43us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:46.995383 (+ 138us) server_negotiation.cc:299] Negotiation successful
0928 20:18:46.995410 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 20:18:46.995736 11966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:46.990560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:34761 (local address 127.24.190.3:33363)
0928 20:18:46.990738 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:46.990774 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:46.991239 (+ 465us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:46.991442 (+ 203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:46.991445 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:46.991453 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:46.991942 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.991946 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.992726 (+ 780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.992727 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.993594 (+ 867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:46.993597 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:46.993993 (+ 396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:46.993994 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:46.994104 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:46.994877 (+ 773us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:46.994877 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:46.994917 (+ 40us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:46.994945 (+ 28us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:46.995284 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:46.995291 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:46.995294 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:46.995379 (+ 85us) client_negotiation.cc:240] Negotiation successful
0928 20:18:46.995486 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":109,"thread_start_us":69,"threads_started":1}
I20260928 20:18:46.996161 11964 heartbeater.cc:347] Connected to a master server at 127.24.190.62:34761
I20260928 20:18:46.996260 11964 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:46.996402 11964 heartbeater.cc:511] Master 127.24.190.62:34761 requested a full tablet report, sending...
I20260928 20:18:46.996677 11514 ts_manager.cc:194] Registered new tserver with Master: d9463185627b46ca8f10f95f1dd87583 (127.24.190.3:46059)
I20260928 20:18:46.997051 11514 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.3:33363
I20260928 20:18:47.006887 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:47.011576 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.008302 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56532 (local address 127.24.190.62:34761)
0928 20:18:47.008342 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.008344 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.008494 (+ 150us) server_negotiation.cc:407] Connection header received
0928 20:18:47.008570 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.008571 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.008581 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.008651 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:47.008853 (+ 202us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.009332 (+ 479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.010103 (+ 771us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.010370 (+ 267us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.010446 (+ 76us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.011181 (+ 735us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:47.011182 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:47.011182 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:47.011187 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:47.011201 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:47.011205 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:47.011310 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.011461 (+ 151us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.011475 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:18:47.013088 11514 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56532:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:47.014890 11514 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:47.021654 11975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.017206 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52612 (local address 127.24.190.2:39187)
0928 20:18:47.017384 (+ 178us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.017390 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.017494 (+ 104us) server_negotiation.cc:407] Connection header received
0928 20:18:47.017749 (+ 255us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.017752 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.017770 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.017874 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:47.018154 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.019301 (+ 1147us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.020475 (+ 1174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.021213 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.021294 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.021392 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.021523 (+ 131us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.021565 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":93,"threads_started":1}
I20260928 20:18:47.021713 11973 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.017134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:39187 (local address 127.0.0.1:52612)
0928 20:18:47.017386 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:47.017430 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:47.017537 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:47.018013 (+ 476us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:47.018014 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:47.018016 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:47.018067 (+ 51us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.018069 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.019421 (+ 1352us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.019422 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.020388 (+ 966us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.020390 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.021315 (+ 925us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.021316 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.021380 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.021391 (+ 11us) client_negotiation.cc:769] Sending connection context
0928 20:18:47.021507 (+ 116us) client_negotiation.cc:240] Negotiation successful
0928 20:18:47.021564 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":228,"mutex_wait_us":9,"thread_start_us":61,"threads_started":1}
I20260928 20:18:47.021713 11974 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.017161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:44631 (local address 127.0.0.1:37930)
0928 20:18:47.017745 (+ 584us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:47.017752 (+ 7us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:47.017811 (+ 59us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:47.018003 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:47.018005 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:47.018007 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:47.018064 (+ 57us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.018066 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.019057 (+ 991us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.019058 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.020579 (+ 1521us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.020581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.021497 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.021498 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.021551 (+ 53us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.021554 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:47.021606 (+ 52us) client_negotiation.cc:240] Negotiation successful
0928 20:18:47.021639 (+ 33us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"mutex_wait_us":74,"thread_start_us":47,"threads_started":1}
I20260928 20:18:47.022012 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.017369 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37930 (local address 127.24.190.1:44631)
0928 20:18:47.017566 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.017570 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.017815 (+ 245us) server_negotiation.cc:407] Connection header received
0928 20:18:47.017873 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.017875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.017889 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.018164 (+ 275us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:47.018230 (+ 66us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.018963 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.020677 (+ 1714us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.021402 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.021468 (+ 66us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.021551 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.021761 (+ 210us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.021932 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":162,"thread_start_us":76,"threads_started":1}
I20260928 20:18:47.022629 11636 tablet_service.cc:1467] Processing CreateTablet for tablet 4a355e26fe0c47aab4ec612d6dab8374 (DEFAULT_TABLE table=test-table [id=89594144763a4c548da7aab2f51a68fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:47.022578 11767 tablet_service.cc:1467] Processing CreateTablet for tablet 4a355e26fe0c47aab4ec612d6dab8374 (DEFAULT_TABLE table=test-table [id=89594144763a4c548da7aab2f51a68fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:47.022981 11767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a355e26fe0c47aab4ec612d6dab8374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:47.022992 11636 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a355e26fe0c47aab4ec612d6dab8374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:47.023305 11972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.017147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:46059 (local address 127.0.0.1:60066)
0928 20:18:47.017608 (+ 461us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:47.017617 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:47.017669 (+ 52us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:47.017971 (+ 302us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:47.017975 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:47.017977 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:47.018054 (+ 77us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.018056 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.019445 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.019446 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.020579 (+ 1133us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.020581 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.023027 (+ 2446us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.023055 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.023120 (+ 65us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.023125 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:47.023192 (+ 67us) client_negotiation.cc:240] Negotiation successful
0928 20:18:47.023237 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":448,"mutex_wait_us":36,"thread_start_us":50,"threads_started":1}
I20260928 20:18:47.023319 11976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.017356 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60066 (local address 127.24.190.3:46059)
0928 20:18:47.017486 (+ 130us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.017490 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.017711 (+ 221us) server_negotiation.cc:407] Connection header received
0928 20:18:47.017755 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.017756 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.017770 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.017864 (+ 94us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:47.018153 (+ 289us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.019369 (+ 1216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.021587 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.022933 (+ 1346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.023013 (+ 80us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.023100 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.023202 (+ 102us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.023241 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":100,"thread_start_us":76,"threads_started":1}
I20260928 20:18:47.024230 11898 tablet_service.cc:1467] Processing CreateTablet for tablet 4a355e26fe0c47aab4ec612d6dab8374 (DEFAULT_TABLE table=test-table [id=89594144763a4c548da7aab2f51a68fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:47.024574 11898 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4a355e26fe0c47aab4ec612d6dab8374. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:47.025921 11978 tablet_bootstrap.cc:492] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Bootstrap starting.
I20260928 20:18:47.026656 11978 tablet_bootstrap.cc:654] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:47.026918 11979 tablet_bootstrap.cc:492] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: Bootstrap starting.
I20260928 20:18:47.027010 11978 log.cc:824] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:47.027544 11979 tablet_bootstrap.cc:654] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:47.027794 11978 tablet_bootstrap.cc:492] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: No bootstrap required, opened a new log
I20260928 20:18:47.027870 11979 log.cc:824] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:47.027912 11981 tablet_bootstrap.cc:492] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Bootstrap starting.
I20260928 20:18:47.028024 11978 ts_tablet_manager.cc:1397] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.002s
I20260928 20:18:47.028563 11979 tablet_bootstrap.cc:492] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: No bootstrap required, opened a new log
I20260928 20:18:47.028566 11981 tablet_bootstrap.cc:654] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:47.028653 11979 ts_tablet_manager.cc:1397] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:18:47.028939 11981 log.cc:824] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:47.030630 11978 raft_consensus.cc:348] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.030809 11978 raft_consensus.cc:374] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:47.030850 11978 raft_consensus.cc:729] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac9af8c47e0b4321b0e4913ff94391f7, State: Initialized, Role: FOLLOWER
I20260928 20:18:47.030748 11979 raft_consensus.cc:348] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.030892 11979 raft_consensus.cc:374] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:47.030923 11981 tablet_bootstrap.cc:492] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: No bootstrap required, opened a new log
I20260928 20:18:47.030936 11979 raft_consensus.cc:729] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef49386b7bdd4405bd4e49198a1e8de6, State: Initialized, Role: FOLLOWER
I20260928 20:18:47.030979 11981 ts_tablet_manager.cc:1397] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s
I20260928 20:18:47.030979 11978 consensus_queue.cc:260] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.031096 11979 consensus_queue.cc:260] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.031253 11978 ts_tablet_manager.cc:1428] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260928 20:18:47.031345 11979 ts_tablet_manager.cc:1428] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: Time spent starting tablet: real 0.003s user 0.000s sys 0.003s
I20260928 20:18:47.031384 11833 heartbeater.cc:503] Master 127.24.190.62:34761 was elected leader, sending a full tablet report...
I20260928 20:18:47.031461 11702 heartbeater.cc:503] Master 127.24.190.62:34761 was elected leader, sending a full tablet report...
I20260928 20:18:47.033385 11981 raft_consensus.cc:348] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.033519 11981 raft_consensus.cc:374] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:47.033541 11981 raft_consensus.cc:729] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9463185627b46ca8f10f95f1dd87583, State: Initialized, Role: FOLLOWER
I20260928 20:18:47.033666 11981 consensus_queue.cc:260] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.033874 11981 ts_tablet_manager.cc:1428] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:18:47.033952 11964 heartbeater.cc:503] Master 127.24.190.62:34761 was elected leader, sending a full tablet report...
W20260928 20:18:47.110167 11834 tablet.cc:2369] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:47.145385 11986 raft_consensus.cc:482] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:47.145574 11986 raft_consensus.cc:504] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.145973 11986 leader_election.cc:288] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ac9af8c47e0b4321b0e4913ff94391f7 (127.24.190.2:39187), ef49386b7bdd4405bd4e49198a1e8de6 (127.24.190.1:44631)
I20260928 20:18:47.150331 11975 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.146308 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:57381 (local address 127.24.190.2:39187)
0928 20:18:47.146352 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.146354 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.146541 (+ 187us) server_negotiation.cc:407] Connection header received
0928 20:18:47.146580 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.146581 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.146590 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.146642 (+ 52us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:47.146887 (+ 245us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.147647 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.149312 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.149882 (+ 570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.149967 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.149977 (+ 10us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.150191 (+ 214us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.150229 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:18:47.150329 11977 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.146351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:48629 (local address 127.24.190.1:44631)
0928 20:18:47.146405 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.146407 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.146418 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:18:47.146449 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.146450 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.146464 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.146555 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:47.146877 (+ 322us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.147643 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.149296 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.149922 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.149987 (+ 65us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.149994 (+ 7us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.150187 (+ 193us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.150228 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":30}
I20260928 20:18:47.150331 11966 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.146236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:44631 (local address 127.24.190.3:48629)
0928 20:18:47.146312 (+ 76us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:47.146325 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:47.146392 (+ 67us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:47.146585 (+ 193us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:47.146586 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:47.146588 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:47.146689 (+ 101us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.146691 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.147786 (+ 1095us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.147787 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.149135 (+ 1348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.149138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.150000 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.150001 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.150089 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.150096 (+ 7us) client_negotiation.cc:769] Sending connection context
0928 20:18:47.150157 (+ 61us) client_negotiation.cc:240] Negotiation successful
0928 20:18:47.150243 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53,"mutex_wait_us":71}
I20260928 20:18:47.150336 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.146236 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:39187 (local address 127.24.190.3:57381)
0928 20:18:47.146436 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:47.146447 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:47.146513 (+ 66us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:47.146662 (+ 149us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:47.146663 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:47.146664 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:47.146752 (+ 88us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.146754 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.147762 (+ 1008us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.147763 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.149135 (+ 1372us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:47.149138 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.149999 (+ 861us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.150000 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:47.150089 (+ 89us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.150097 (+ 8us) client_negotiation.cc:769] Sending connection context
0928 20:18:47.150157 (+ 60us) client_negotiation.cc:240] Negotiation successful
0928 20:18:47.150201 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":182,"mutex_wait_us":99,"thread_start_us":134,"threads_started":1}
I20260928 20:18:47.150729 11787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a355e26fe0c47aab4ec612d6dab8374" candidate_uuid: "d9463185627b46ca8f10f95f1dd87583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" is_pre_election: true
I20260928 20:18:47.150727 11656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a355e26fe0c47aab4ec612d6dab8374" candidate_uuid: "d9463185627b46ca8f10f95f1dd87583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" is_pre_election: true
I20260928 20:18:47.150892 11787 raft_consensus.cc:2454] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9463185627b46ca8f10f95f1dd87583 in term 0.
I20260928 20:18:47.150892 11656 raft_consensus.cc:2454] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d9463185627b46ca8f10f95f1dd87583 in term 0.
I20260928 20:18:47.151117 11854 leader_election.cc:302] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ac9af8c47e0b4321b0e4913ff94391f7, d9463185627b46ca8f10f95f1dd87583; no voters:
I20260928 20:18:47.151288 11986 raft_consensus.cc:2781] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:47.151347 11986 raft_consensus.cc:482] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:47.151374 11986 raft_consensus.cc:3037] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:47.152096 11986 raft_consensus.cc:504] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.152225 11986 leader_election.cc:288] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [CANDIDATE]: Term 1 election: Requested vote from peers ac9af8c47e0b4321b0e4913ff94391f7 (127.24.190.2:39187), ef49386b7bdd4405bd4e49198a1e8de6 (127.24.190.1:44631)
I20260928 20:18:47.152421 11656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a355e26fe0c47aab4ec612d6dab8374" candidate_uuid: "d9463185627b46ca8f10f95f1dd87583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef49386b7bdd4405bd4e49198a1e8de6"
I20260928 20:18:47.152421 11787 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a355e26fe0c47aab4ec612d6dab8374" candidate_uuid: "d9463185627b46ca8f10f95f1dd87583" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac9af8c47e0b4321b0e4913ff94391f7"
I20260928 20:18:47.152508 11656 raft_consensus.cc:3037] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:47.152508 11787 raft_consensus.cc:3037] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:47.153460 11656 raft_consensus.cc:2454] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9463185627b46ca8f10f95f1dd87583 in term 1.
I20260928 20:18:47.153460 11787 raft_consensus.cc:2454] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d9463185627b46ca8f10f95f1dd87583 in term 1.
I20260928 20:18:47.153700 11852 leader_election.cc:302] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d9463185627b46ca8f10f95f1dd87583, ef49386b7bdd4405bd4e49198a1e8de6; no voters:
I20260928 20:18:47.153820 11986 raft_consensus.cc:2781] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:47.153985 11986 raft_consensus.cc:686] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 1 LEADER]: Becoming Leader. State: Replica: d9463185627b46ca8f10f95f1dd87583, State: Running, Role: LEADER
I20260928 20:18:47.154102 11986 consensus_queue.cc:237] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } }
I20260928 20:18:47.154995 11514 catalog_manager.cc:5495] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 reported cstate change: term changed from 0 to 1, leader changed from <none> to d9463185627b46ca8f10f95f1dd87583 (127.24.190.3). New cstate: current_term: 1 leader_uuid: "d9463185627b46ca8f10f95f1dd87583" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d9463185627b46ca8f10f95f1dd87583" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46059 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 } health_report { overall_health: UNKNOWN } } }
I20260928 20:18:47.171135 11976 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.168692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60078 (local address 127.24.190.3:46059)
0928 20:18:47.168761 (+ 69us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:47.168763 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:47.168773 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:18:47.168810 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:47.168811 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:47.168835 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:47.168912 (+ 77us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:47.169074 (+ 162us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.169565 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.170374 (+ 809us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:47.170565 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:47.170651 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:47.170794 (+ 143us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:47.170884 (+ 90us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:47.170996 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:47.171027 (+ 31us) server_negotiation.cc:299] Negotiation successful
0928 20:18:47.171037 (+ 10us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 20:18:47.173012 11787 raft_consensus.cc:1261] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 1 FOLLOWER]: Refusing update from remote peer d9463185627b46ca8f10f95f1dd87583: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:47.173034 11656 raft_consensus.cc:1261] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 1 FOLLOWER]: Refusing update from remote peer d9463185627b46ca8f10f95f1dd87583: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:47.173395 11988 consensus_queue.cc:1035] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef49386b7bdd4405bd4e49198a1e8de6" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 44631 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:47.173537 11986 consensus_queue.cc:1035] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac9af8c47e0b4321b0e4913ff94391f7" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 39187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:47.176129 11992 mvcc.cc:205] Tried to move back new op lower bound from 7334407074497810432 to 7334407074424033280. Current Snapshot: MvccSnapshot[applied={T|T < 7334407074497810432}]
I20260928 20:18:47.177095 11991 mvcc.cc:205] Tried to move back new op lower bound from 7334407074497810432 to 7334407074424033280. Current Snapshot: MvccSnapshot[applied={T|T < 7334407074497810432 or (T in {7334407074497810432})}]
I20260928 20:18:47.177229 11993 mvcc.cc:205] Tried to move back new op lower bound from 7334407074497810432 to 7334407074424033280. Current Snapshot: MvccSnapshot[applied={T|T < 7334407074497810432 or (T in {7334407074497810432})}]
I20260928 20:18:47.178385 11513 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:47.178488 11513 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:56532:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:47.179288 11513 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 32f885ff287c45158e46dc301541cc1b: Sending DeleteTablet for 3 replicas of tablet 4a355e26fe0c47aab4ec612d6dab8374
I20260928 20:18:47.179623 11636 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a355e26fe0c47aab4ec612d6dab8374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:47 UTC) from {username='slave'} at 127.0.0.1:37930
I20260928 20:18:47.179623 11767 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a355e26fe0c47aab4ec612d6dab8374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:47 UTC) from {username='slave'} at 127.0.0.1:52612
I20260928 20:18:47.179889 12001 tablet_replica.cc:330] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: stopping tablet replica
I20260928 20:18:47.179968 12000 tablet_replica.cc:330] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: stopping tablet replica
I20260928 20:18:47.179967 11898 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a355e26fe0c47aab4ec612d6dab8374 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:47 UTC) from {username='slave'} at 127.0.0.1:60066
I20260928 20:18:47.180095 12000 raft_consensus.cc:2229] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:47.180110 12001 raft_consensus.cc:2229] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:47.180217 12000 raft_consensus.cc:2258] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:47.180424 12001 raft_consensus.cc:2258] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:47.180480 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11574
I20260928 20:18:47.180639 12000 ts_tablet_manager.cc:1905] T 4a355e26fe0c47aab4ec612d6dab8374 P ef49386b7bdd4405bd4e49198a1e8de6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:47.181006 12001 ts_tablet_manager.cc:1905] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:47.182904 12001 ts_tablet_manager.cc:1918] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:47.182978 12001 log.cc:1196] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/4a355e26fe0c47aab4ec612d6dab8374
I20260928 20:18:47.183243 12001 ts_tablet_manager.cc:1939] T 4a355e26fe0c47aab4ec612d6dab8374 P ac9af8c47e0b4321b0e4913ff94391f7: Deleting consensus metadata
I20260928 20:18:47.183789 11501 catalog_manager.cc:4841] TS ac9af8c47e0b4321b0e4913ff94391f7 (127.24.190.2:39187): tablet 4a355e26fe0c47aab4ec612d6dab8374 (table test-table [id=89594144763a4c548da7aab2f51a68fb]) successfully deleted
W20260928 20:18:47.186762 11499 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:44631 (error 108)
I20260928 20:18:47.187275 11972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:47.187130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:44631 (local address 127.0.0.1:37942)
0928 20:18:47.187196 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:47.187239 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:44631: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 20:18:47.187309 12002 tablet_replica.cc:330] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: stopping tablet replica
I20260928 20:18:47.187408 12002 raft_consensus.cc:2229] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 1 LEADER]: Raft consensus shutting down.
W20260928 20:18:47.187448 11499 catalog_manager.cc:4584] TS ef49386b7bdd4405bd4e49198a1e8de6 (127.24.190.1:44631): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 4a355e26fe0c47aab4ec612d6dab8374: Network error: Client connection negotiation failed: client connection to 127.24.190.1:44631: connect: Connection refused (error 111)
I20260928 20:18:47.187510 12002 raft_consensus.cc:2258] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:47.187685 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11705
I20260928 20:18:47.192029 12002 ts_tablet_manager.cc:1905] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:47.193933 12002 ts_tablet_manager.cc:1918] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:47.194016 12002 log.cc:1196] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/4a355e26fe0c47aab4ec612d6dab8374
I20260928 20:18:47.194301 12002 ts_tablet_manager.cc:1939] T 4a355e26fe0c47aab4ec612d6dab8374 P d9463185627b46ca8f10f95f1dd87583: Deleting consensus metadata
I20260928 20:18:47.194742 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11836
I20260928 20:18:47.196067 11498 catalog_manager.cc:4841] TS d9463185627b46ca8f10f95f1dd87583 (127.24.190.3:46059): tablet 4a355e26fe0c47aab4ec612d6dab8374 (table test-table [id=89594144763a4c548da7aab2f51a68fb]) successfully deleted
I20260928 20:18:47.199043 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 11483
2026-09-28T20:18:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (840 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:47 dist-test-slave-n45k krb5kdc[12006](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:47 dist-test-slave-n45k krb5kdc[12006](info): set up 2 sockets
Sep 28 20:18:47 dist-test-slave-n45k krb5kdc[12006](info): commencing operation
krb5kdc: starting...
W20260928 20:18:48.243181 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.024s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:18:48.369452 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:40625
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:40625
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:48.453679 12019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:48.453996 12019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:48.454042 12019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:48.455313 12019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:48.455397 12019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:48.455422 12019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:48.455443 12019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:48.455472 12019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:48.457176 12019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:40625
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:40625
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12019
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:48.457515 12019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:48.457950 12019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:48.463312 12027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:48.463358 12019 server_base.cc:1034] running on GCE node
W20260928 20:18:48.463325 12024 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.463338 12025 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:48.463786 12019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:48.464124 12019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:48.465271 12019 hybrid_clock.cc:648] HybridClock initialized: now 1790626728465261 us; error 33 us; skew 500 ppm
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:48.467891 12019 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:18:48.468303 12019 webserver.cc:460] Webserver started at http://127.24.190.62:45263/ using document root <none> and password file <none>
I20260928 20:18:48.468549 12019 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:48.468597 12019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:48.468755 12019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:48.469853 12019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "909b75581c8947ecb00875d089261023"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "425aaaec0b5796c7bf69be3b85ea7bfe"
server_key_iv: "847f9461f732a0606259099dea0dd16e"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.470244 12019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "909b75581c8947ecb00875d089261023"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "425aaaec0b5796c7bf69be3b85ea7bfe"
server_key_iv: "847f9461f732a0606259099dea0dd16e"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.471694 12019 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:48.472653 12034 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.472870 12019 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:48.472995 12019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "909b75581c8947ecb00875d089261023"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "425aaaec0b5796c7bf69be3b85ea7bfe"
server_key_iv: "847f9461f732a0606259099dea0dd16e"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.473173 12019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:48.491235 12019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:48.493273 12019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:48.493449 12019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:48.497607 12019 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:40625
I20260928 20:18:48.497645 12086 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:40625 every 8 connection(s)
I20260928 20:18:48.498020 12019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:48.498920 12087 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:48.501159 12087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023: Bootstrap starting.
I20260928 20:18:48.501724 12087 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:48.501955 12087 log.cc:824] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:48.502676 12087 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023: No bootstrap required, opened a new log
I20260928 20:18:48.504169 12087 raft_consensus.cc:348] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909b75581c8947ecb00875d089261023" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40625 } }
I20260928 20:18:48.504312 12087 raft_consensus.cc:374] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:48.504335 12087 raft_consensus.cc:729] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 909b75581c8947ecb00875d089261023, State: Initialized, Role: FOLLOWER
I20260928 20:18:48.504484 12087 consensus_queue.cc:260] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909b75581c8947ecb00875d089261023" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40625 } }
I20260928 20:18:48.504571 12087 raft_consensus.cc:388] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:48.504594 12087 raft_consensus.cc:482] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:48.504659 12087 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:48.504716 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12019
I20260928 20:18:48.504844 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:48.505046 25336 external_mini_cluster.cc:1428] Setting key 687080c6217dbced95439411afc051d4
I20260928 20:18:48.505328 12087 raft_consensus.cc:504] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909b75581c8947ecb00875d089261023" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40625 } }
I20260928 20:18:48.505447 12087 leader_election.cc:302] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 909b75581c8947ecb00875d089261023; no voters:
I20260928 20:18:48.505788 12087 leader_election.cc:288] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:48.505827 12092 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:48.505947 12092 raft_consensus.cc:686] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [term 1 LEADER]: Becoming Leader. State: Replica: 909b75581c8947ecb00875d089261023, State: Running, Role: LEADER
I20260928 20:18:48.506047 12087 sys_catalog.cc:564] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:48.506034 12092 consensus_queue.cc:237] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909b75581c8947ecb00875d089261023" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40625 } }
I20260928 20:18:48.506382 12092 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 909b75581c8947ecb00875d089261023. Latest consensus state: current_term: 1 leader_uuid: "909b75581c8947ecb00875d089261023" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909b75581c8947ecb00875d089261023" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40625 } } }
I20260928 20:18:48.506454 12092 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:48.506836 12096 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:48.508009 12096 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:48.508486 12094 sys_catalog.cc:455] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "909b75581c8947ecb00875d089261023" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "909b75581c8947ecb00875d089261023" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40625 } } }
I20260928 20:18:48.508574 12094 sys_catalog.cc:458] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:48.509704 12096 catalog_manager.cc:1347] Generated new cluster ID: 8cbcfcecbd8348dabc0e8f13d0f84b8f
I20260928 20:18:48.509769 12096 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:48.517825 12096 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:48.517889 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:48.505572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41952 (local address 127.24.190.62:40625)
0928 20:18:48.505742 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:48.505753 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:48.505794 (+ 41us) server_negotiation.cc:407] Connection header received
0928 20:18:48.505928 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:48.505935 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:48.505998 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:48.506313 (+ 315us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:48.507083 (+ 770us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.508994 (+ 1911us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.510069 (+ 1075us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.510713 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.510814 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:48.513601 (+ 2787us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:48.513606 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:48.513606 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:48.513618 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:48.516240 (+ 2622us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:48.516641 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:48.516645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:48.516645 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:48.516766 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:48.516991 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:48.516991 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:48.516992 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:48.517272 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:48.517439 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:48.517515 (+ 76us) server_negotiation.cc:299] Negotiation successful
0928 20:18:48.517650 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":74,"threads_started":1}
I20260928 20:18:48.518684 12096 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:48.524401 12096 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023: Generated new TSK 0
I20260928 20:18:48.524596 12096 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.24.190.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
Entry for principal kudu/127.24.190.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab.
I20260928 20:18:48.558085 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40625
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:48.643858 12113 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:48.644107 12113 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:48.644135 12113 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:48.645421 12113 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:48.645471 12113 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:48.645500 12113 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:48.647152 12113 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.1.keytab
--principal=kudu/127.24.190.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12113
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:48.647408 12113 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:48.647657 12113 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:48.653111 12119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.653118 12118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.653190 12121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:48.653543 12113 server_base.cc:1034] running on GCE node
I20260928 20:18:48.653834 12113 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:48.654140 12113 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:48.655320 12113 hybrid_clock.cc:648] HybridClock initialized: now 1790626728655307 us; error 30 us; skew 500 ppm
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:48.658145 12113 init.cc:377] Logged in from keytab as kudu/127.24.190.1@KRBTEST.COM (short username kudu)
I20260928 20:18:48.658703 12113 webserver.cc:460] Webserver started at http://127.24.190.1:32991/ using document root <none> and password file <none>
I20260928 20:18:48.658968 12113 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:48.659044 12113 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:48.659209 12113 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:48.660470 12113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "e7b37119a52f48448e31d4753355eb21"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "9a94c848de556a3ec4345bb0bf85255a"
server_key_iv: "ebdb5454359da1c0c33427c2658ecb3e"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.660878 12113 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "e7b37119a52f48448e31d4753355eb21"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "9a94c848de556a3ec4345bb0bf85255a"
server_key_iv: "ebdb5454359da1c0c33427c2658ecb3e"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.662501 12113 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:18:48.663376 12128 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.663697 12113 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:48.663787 12113 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "e7b37119a52f48448e31d4753355eb21"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "9a94c848de556a3ec4345bb0bf85255a"
server_key_iv: "ebdb5454359da1c0c33427c2658ecb3e"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.663885 12113 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:48.674342 12113 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:48.676873 12113 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:48.677039 12113 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:48.677340 12113 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:48.677661 12113 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:48.677695 12113 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.677718 12113 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:48.677764 12113 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.683833 12113 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:39049
I20260928 20:18:48.683923 12241 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:39049 every 8 connection(s)
I20260928 20:18:48.684263 12113 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.1@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:48.694154 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12113
I20260928 20:18:48.694221 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:48.685071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:35957 (local address 127.24.190.62:40625)
0928 20:18:48.685149 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:48.685151 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:48.685377 (+ 226us) server_negotiation.cc:407] Connection header received
0928 20:18:48.685884 (+ 507us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:48.685885 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:48.685896 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:48.685964 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:48.687002 (+ 1038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.687590 (+ 588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.688631 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.688842 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.688903 (+ 61us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:48.691318 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:48.691320 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:48.691320 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:48.691327 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:48.692615 (+ 1288us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:48.693042 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:48.693043 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:48.693043 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:48.693188 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:48.693474 (+ 286us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:48.693474 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:48.693475 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:48.693594 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:48.693651 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:48.694008 (+ 357us) server_negotiation.cc:299] Negotiation successful
0928 20:18:48.694116 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 20:18:48.694325 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:18:48.694372 12244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:48.685047 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:40625 (local address 127.24.190.1:35957)
0928 20:18:48.685240 (+ 193us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:48.685286 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:48.685764 (+ 478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:48.686020 (+ 256us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:48.686023 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:48.686699 (+ 676us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:48.686902 (+ 203us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:48.686908 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.687692 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.687693 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:48.688543 (+ 850us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:48.688545 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.688947 (+ 402us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.688948 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:48.689067 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:48.689591 (+ 524us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:48.689600 (+ 9us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:48.691194 (+ 1594us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:48.692693 (+ 1499us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:48.692700 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:48.692701 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:48.692970 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:48.693293 (+ 323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:48.693294 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:48.693295 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:48.693407 (+ 112us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:48.693678 (+ 271us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:48.693684 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:48.693823 (+ 139us) client_negotiation.cc:769] Sending connection context
0928 20:18:48.693930 (+ 107us) client_negotiation.cc:240] Negotiation successful
0928 20:18:48.694064 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":151,"thread_start_us":100,"threads_started":1}
I20260928 20:18:48.694533 25336 external_mini_cluster.cc:1428] Setting key b0bee262f47f4014ee1e719a95af0f70
I20260928 20:18:48.695013 12242 heartbeater.cc:347] Connected to a master server at 127.24.190.62:40625
I20260928 20:18:48.695237 12242 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:48.695459 12242 heartbeater.cc:511] Master 127.24.190.62:40625 requested a full tablet report, sending...
I20260928 20:18:48.696074 12051 ts_manager.cc:194] Registered new tserver with Master: e7b37119a52f48448e31d4753355eb21 (127.24.190.1:39049)
I20260928 20:18:48.696910 12051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.1@KRBTEST.COM'} at 127.24.190.1:35957
WARNING: no policy specified for kudu/127.24.190.2@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.2@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
Entry for principal kudu/127.24.190.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab.
I20260928 20:18:48.721671 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40625
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:48.802343 12247 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:48.802562 12247 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:48.802587 12247 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:48.803774 12247 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:48.803817 12247 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:48.803869 12247 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:48.805336 12247 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.2.keytab
--principal=kudu/127.24.190.2
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12247
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:48.805583 12247 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:48.805843 12247 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:48.811410 12252 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.811522 12255 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.811410 12253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:48.811662 12247 server_base.cc:1034] running on GCE node
I20260928 20:18:48.811918 12247 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:48.812170 12247 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:48.813336 12247 hybrid_clock.cc:648] HybridClock initialized: now 1790626728813331 us; error 39 us; skew 500 ppm
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:48.815852 12247 init.cc:377] Logged in from keytab as kudu/127.24.190.2@KRBTEST.COM (short username kudu)
I20260928 20:18:48.816360 12247 webserver.cc:460] Webserver started at http://127.24.190.2:45109/ using document root <none> and password file <none>
I20260928 20:18:48.816582 12247 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:48.816650 12247 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:48.816808 12247 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:48.817884 12247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "af8df9faf420485494cbcf432067d2a1"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "1872d9da932f9609bd44f11303312891"
server_key_iv: "3b5c7282e2f9fc9c1b4579b060a295d1"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.818239 12247 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "af8df9faf420485494cbcf432067d2a1"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "1872d9da932f9609bd44f11303312891"
server_key_iv: "3b5c7282e2f9fc9c1b4579b060a295d1"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.819702 12247 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:48.820525 12262 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.820734 12247 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:48.820837 12247 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "af8df9faf420485494cbcf432067d2a1"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "1872d9da932f9609bd44f11303312891"
server_key_iv: "3b5c7282e2f9fc9c1b4579b060a295d1"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.820920 12247 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:48.830786 12247 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:48.832742 12247 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:48.832927 12247 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:48.833161 12247 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:48.833459 12247 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:48.833513 12247 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.833554 12247 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:48.833582 12247 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.839545 12247 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:35427
I20260928 20:18:48.839591 12375 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:35427 every 8 connection(s)
I20260928 20:18:48.839908 12247 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.2@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:48.846778 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12247
I20260928 20:18:48.846909 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:18:48.847416 25336 external_mini_cluster.cc:1428] Setting key 3258f3f0b905bc23976edb39291b02bb
I20260928 20:18:48.849715 12378 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:48.840609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:40625 (local address 127.24.190.2:37885)
0928 20:18:48.840784 (+ 175us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:48.840819 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:48.841403 (+ 584us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:48.841674 (+ 271us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:48.841678 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:48.842246 (+ 568us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:48.842515 (+ 269us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:48.842520 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.843259 (+ 739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.843260 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:48.844055 (+ 795us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:48.844057 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.844480 (+ 423us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.844481 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:48.844610 (+ 129us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:48.845155 (+ 545us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:48.845163 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:48.846569 (+ 1406us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:48.848371 (+ 1802us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:48.848378 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:48.848381 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:48.848619 (+ 238us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:48.848823 (+ 204us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:48.848824 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:48.848824 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:48.848918 (+ 94us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:48.849218 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:48.849223 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:48.849363 (+ 140us) client_negotiation.cc:769] Sending connection context
0928 20:18:48.849448 (+ 85us) client_negotiation.cc:240] Negotiation successful
0928 20:18:48.849562 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":128,"thread_start_us":78,"threads_started":1}
I20260928 20:18:48.849720 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:48.840643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:37885 (local address 127.24.190.62:40625)
0928 20:18:48.840733 (+ 90us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:48.840736 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:48.840909 (+ 173us) server_negotiation.cc:407] Connection header received
0928 20:18:48.841523 (+ 614us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:48.841524 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:48.841537 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:48.841595 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:48.842615 (+ 1020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.843144 (+ 529us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.844172 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:48.844383 (+ 211us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:48.844469 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:48.846663 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:48.846665 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:48.846665 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:48.846674 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:48.848245 (+ 1571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:48.848697 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:48.848698 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:48.848699 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:48.848755 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:48.848981 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:48.848982 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:48.848983 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:48.849147 (+ 164us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:48.849215 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:48.849490 (+ 275us) server_negotiation.cc:299] Negotiation successful
0928 20:18:48.849578 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":43}
I20260928 20:18:48.850409 12376 heartbeater.cc:347] Connected to a master server at 127.24.190.62:40625
I20260928 20:18:48.850518 12376 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:48.850718 12376 heartbeater.cc:511] Master 127.24.190.62:40625 requested a full tablet report, sending...
I20260928 20:18:48.851064 12051 ts_manager.cc:194] Registered new tserver with Master: af8df9faf420485494cbcf432067d2a1 (127.24.190.2:35427)
I20260928 20:18:48.851490 12051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.2@KRBTEST.COM'} at 127.24.190.2:37885
WARNING: no policy specified for kudu/127.24.190.3@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.3@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
Entry for principal kudu/127.24.190.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab.
I20260928 20:18:48.873459 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40625
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35319
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:48.954861 12381 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:48.955152 12381 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:48.955196 12381 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:48.956373 12381 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:48.956447 12381 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:48.956494 12381 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:48.957985 12381 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35319
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.3.keytab
--principal=kudu/127.24.190.3
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40625
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12381
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:48.958261 12381 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:48.958511 12381 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:48.963594 12387 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.963580 12386 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:48.963560 12389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:48.963873 12381 server_base.cc:1034] running on GCE node
I20260928 20:18:48.964244 12381 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:48.964501 12381 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:48.965670 12381 hybrid_clock.cc:648] HybridClock initialized: now 1790626728965657 us; error 43 us; skew 500 ppm
Sep 28 20:18:48 dist-test-slave-n45k krb5kdc[12006](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:48.968335 12381 init.cc:377] Logged in from keytab as kudu/127.24.190.3@KRBTEST.COM (short username kudu)
I20260928 20:18:48.968813 12381 webserver.cc:460] Webserver started at http://127.24.190.3:36593/ using document root <none> and password file <none>
I20260928 20:18:48.969044 12381 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:48.969121 12381 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:48.969270 12381 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:48.970564 12381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "b88c313194fd4a9d8284580aae48a164"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "323d9253479a6639925b53b2c96f3bdf"
server_key_iv: "6291ee387cb723b1ba3c449ac0b6114f"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.970925 12381 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "b88c313194fd4a9d8284580aae48a164"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "323d9253479a6639925b53b2c96f3bdf"
server_key_iv: "6291ee387cb723b1ba3c449ac0b6114f"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.972203 12381 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:18:48.972888 12396 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:48.973052 12381 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:18:48.973153 12381 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "b88c313194fd4a9d8284580aae48a164"
format_stamp: "Formatted at 2026-09-28 20:18:48 on dist-test-slave-n45k"
server_key: "323d9253479a6639925b53b2c96f3bdf"
server_key_iv: "6291ee387cb723b1ba3c449ac0b6114f"
server_key_version: "encryptionkey@0"
I20260928 20:18:48.973232 12381 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:49.000766 12381 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:49.003005 12381 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:49.003171 12381 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:49.003407 12381 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:49.003718 12381 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:49.003775 12381 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.003818 12381 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:49.003845 12381 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.010134 12381 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:34359
I20260928 20:18:49.010179 12509 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:34359 every 8 connection(s)
I20260928 20:18:49.010557 12381 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
Sep 28 20:18:49 dist-test-slave-n45k krb5kdc[12006](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626728, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.3@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:18:49.018671 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12381
I20260928 20:18:49.018821 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:18:49.018994 25336 external_mini_cluster.cc:1428] Setting key 1817b8796db04c13b8717998e34511f5
I20260928 20:18:49.020017 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.011288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:36939 (local address 127.24.190.62:40625)
0928 20:18:49.011333 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.011335 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.011510 (+ 175us) server_negotiation.cc:407] Connection header received
0928 20:18:49.011993 (+ 483us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.011995 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.012005 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.012056 (+ 51us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:49.012957 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.013478 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.014477 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.014694 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.014752 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.016846 (+ 2094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:49.016847 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:49.016847 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:49.016853 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:49.018382 (+ 1529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:49.018739 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:49.018741 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:49.018741 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:49.018807 (+ 66us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:49.019287 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:49.019288 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:49.019288 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:49.019444 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:49.019512 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.019852 (+ 340us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.019940 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:18:49.020263 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.011277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:40625 (local address 127.24.190.3:36939)
0928 20:18:49.011411 (+ 134us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.011445 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.011906 (+ 461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.012110 (+ 204us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.012113 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.012677 (+ 564us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:49.012870 (+ 193us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.012875 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.013558 (+ 683us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.013559 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.014406 (+ 847us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.014408 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.014767 (+ 359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.014767 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.014866 (+ 99us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.015450 (+ 584us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:18:49.015458 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:49.016764 (+ 1306us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:49.018446 (+ 1682us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:49.018452 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:49.018453 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:49.018662 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:49.018887 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:18:49.018888 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:18:49.018888 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:18:49.019001 (+ 113us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:18:49.019515 (+ 514us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:49.019520 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:49.019696 (+ 176us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.019818 (+ 122us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.019987 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":99,"thread_start_us":73,"threads_started":1}
I20260928 20:18:49.020743 12510 heartbeater.cc:347] Connected to a master server at 127.24.190.62:40625
I20260928 20:18:49.020862 12510 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:49.021009 12510 heartbeater.cc:511] Master 127.24.190.62:40625 requested a full tablet report, sending...
I20260928 20:18:49.021344 12051 ts_manager.cc:194] Registered new tserver with Master: b88c313194fd4a9d8284580aae48a164 (127.24.190.3:34359)
I20260928 20:18:49.021674 12051 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.24.190.3@KRBTEST.COM'} at 127.24.190.3:36939
I20260928 20:18:49.030745 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:49.038362 12091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.032147 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41962 (local address 127.24.190.62:40625)
0928 20:18:49.032225 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.032227 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.032320 (+ 93us) server_negotiation.cc:407] Connection header received
0928 20:18:49.032387 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.032388 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.032398 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.032467 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:49.033031 (+ 564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.033530 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.034266 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.034495 (+ 229us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.034604 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.035727 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:49.035728 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:49.035729 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:49.035736 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:49.037178 (+ 1442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:49.037535 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:49.037536 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:49.037537 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:49.037594 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:49.037807 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:49.037808 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:49.037808 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:49.037955 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:49.038063 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.038162 (+ 99us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.038239 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34}
I20260928 20:18:49.040155 12051 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41962:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:49.041656 12051 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:49.047863 12523 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.043888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:34359 (local address 127.0.0.1:50278)
0928 20:18:49.044345 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.044388 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.044472 (+ 84us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.044759 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.044762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.044766 (+ 4us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:49.044850 (+ 84us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.044853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.045781 (+ 928us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.045782 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.046739 (+ 957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.046741 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.047568 (+ 827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.047569 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.047647 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.047661 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.047736 (+ 75us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.047784 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":422,"mutex_wait_us":38,"thread_start_us":45,"threads_started":1}
I20260928 20:18:49.047894 12524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.043969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50278 (local address 127.24.190.3:34359)
0928 20:18:49.044115 (+ 146us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.044119 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.044469 (+ 350us) server_negotiation.cc:407] Connection header received
0928 20:18:49.044561 (+ 92us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.044563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.044580 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.044666 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:49.044920 (+ 254us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.045684 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.046840 (+ 1156us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.047481 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.047554 (+ 73us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.047611 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.047763 (+ 152us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.047810 (+ 47us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260928 20:18:49.048261 12522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.043902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:39049 (local address 127.0.0.1:48206)
0928 20:18:49.044582 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.044590 (+ 8us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.044672 (+ 82us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.044950 (+ 278us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.044952 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.044954 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:49.044998 (+ 44us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.045000 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.045856 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.045858 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.047026 (+ 1168us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.047028 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.048016 (+ 988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.048018 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.048074 (+ 56us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.048078 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.048131 (+ 53us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.048175 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"mutex_wait_us":4,"thread_start_us":94,"threads_started":1}
I20260928 20:18:49.048277 12526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.044247 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48206 (local address 127.24.190.1:39049)
0928 20:18:49.044417 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.044420 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.044732 (+ 312us) server_negotiation.cc:407] Connection header received
0928 20:18:49.044776 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.044779 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.044795 (+ 16us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.044864 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:49.045065 (+ 201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.045720 (+ 655us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.047114 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.047852 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.047920 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.047978 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.048162 (+ 184us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.048202 (+ 40us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":131,"thread_start_us":80,"threads_started":1}
I20260928 20:18:49.049077 12444 tablet_service.cc:1467] Processing CreateTablet for tablet e9d4e0d5a934487689e59731c1360be5 (DEFAULT_TABLE table=test-table [id=556d465358f940cb993430e767ac654a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:49.049050 12176 tablet_service.cc:1467] Processing CreateTablet for tablet e9d4e0d5a934487689e59731c1360be5 (DEFAULT_TABLE table=test-table [id=556d465358f940cb993430e767ac654a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:49.049415 12444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9d4e0d5a934487689e59731c1360be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:49.049415 12176 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9d4e0d5a934487689e59731c1360be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:49.049535 12521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.043902 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:35427 (local address 127.0.0.1:59246)
0928 20:18:49.044400 (+ 498us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.044411 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.044472 (+ 61us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.044759 (+ 287us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.044762 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.044764 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:49.044850 (+ 86us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.044853 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.047278 (+ 2425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.047279 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.048281 (+ 1002us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.048284 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.049253 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.049254 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.049318 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.049321 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.049401 (+ 80us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.049439 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"mutex_wait_us":19,"thread_start_us":92,"threads_started":1}
I20260928 20:18:49.049531 12525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.044150 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59246 (local address 127.24.190.2:35427)
0928 20:18:49.044315 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.044318 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.044466 (+ 148us) server_negotiation.cc:407] Connection header received
0928 20:18:49.044561 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.044563 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.044580 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.044666 (+ 86us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:49.045780 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.047187 (+ 1407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.048377 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.049122 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.049215 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.049267 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.049415 (+ 148us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.049453 (+ 38us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":135,"thread_start_us":86,"threads_started":1}
I20260928 20:18:49.050237 12310 tablet_service.cc:1467] Processing CreateTablet for tablet e9d4e0d5a934487689e59731c1360be5 (DEFAULT_TABLE table=test-table [id=556d465358f940cb993430e767ac654a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:49.050616 12310 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e9d4e0d5a934487689e59731c1360be5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:49.052734 12527 tablet_bootstrap.cc:492] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Bootstrap starting.
I20260928 20:18:49.052959 12528 tablet_bootstrap.cc:492] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: Bootstrap starting.
I20260928 20:18:49.053332 12529 tablet_bootstrap.cc:492] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Bootstrap starting.
I20260928 20:18:49.053669 12528 tablet_bootstrap.cc:654] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:49.053975 12529 tablet_bootstrap.cc:654] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:49.054306 12528 log.cc:824] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:49.054539 12529 log.cc:824] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:49.055065 12527 tablet_bootstrap.cc:654] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:49.055154 12528 tablet_bootstrap.cc:492] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: No bootstrap required, opened a new log
I20260928 20:18:49.055230 12528 ts_tablet_manager.cc:1397] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:18:49.055573 12527 log.cc:824] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:49.056247 12527 tablet_bootstrap.cc:492] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: No bootstrap required, opened a new log
I20260928 20:18:49.056303 12527 ts_tablet_manager.cc:1397] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s
I20260928 20:18:49.056753 12528 raft_consensus.cc:348] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.056917 12528 raft_consensus.cc:374] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:49.056962 12528 raft_consensus.cc:729] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e7b37119a52f48448e31d4753355eb21, State: Initialized, Role: FOLLOWER
I20260928 20:18:49.057077 12528 consensus_queue.cc:260] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.057353 12528 ts_tablet_manager.cc:1428] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260928 20:18:49.057372 12242 heartbeater.cc:503] Master 127.24.190.62:40625 was elected leader, sending a full tablet report...
I20260928 20:18:49.057962 12529 tablet_bootstrap.cc:492] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: No bootstrap required, opened a new log
I20260928 20:18:49.058048 12529 ts_tablet_manager.cc:1397] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s
I20260928 20:18:49.058190 12527 raft_consensus.cc:348] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.058388 12527 raft_consensus.cc:374] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:49.058435 12527 raft_consensus.cc:729] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b88c313194fd4a9d8284580aae48a164, State: Initialized, Role: FOLLOWER
I20260928 20:18:49.058553 12527 consensus_queue.cc:260] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.058872 12527 ts_tablet_manager.cc:1428] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:18:49.058900 12510 heartbeater.cc:503] Master 127.24.190.62:40625 was elected leader, sending a full tablet report...
I20260928 20:18:49.060195 12529 raft_consensus.cc:348] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.060340 12529 raft_consensus.cc:374] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:49.060385 12529 raft_consensus.cc:729] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af8df9faf420485494cbcf432067d2a1, State: Initialized, Role: FOLLOWER
I20260928 20:18:49.060489 12529 consensus_queue.cc:260] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.060747 12529 ts_tablet_manager.cc:1428] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:18:49.060808 12376 heartbeater.cc:503] Master 127.24.190.62:40625 was elected leader, sending a full tablet report...
W20260928 20:18:49.090456 12377 tablet.cc:2369] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:18:49.185026 12243 tablet.cc:2369] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260928 20:18:49.261158 12511 tablet.cc:2369] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260928 20:18:49.346738 12534 raft_consensus.cc:482] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:49.346874 12534 raft_consensus.cc:504] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.347365 12534 leader_election.cc:288] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e7b37119a52f48448e31d4753355eb21 (127.24.190.1:39049), af8df9faf420485494cbcf432067d2a1 (127.24.190.2:35427)
I20260928 20:18:49.350219 12512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.347538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:39049 (local address 127.24.190.3:39847)
0928 20:18:49.347598 (+ 60us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.347612 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.347662 (+ 50us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.347816 (+ 154us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.347817 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.347818 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:49.347896 (+ 78us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.347897 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.348588 (+ 691us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.348589 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.349357 (+ 768us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.349359 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.349948 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.349949 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.350036 (+ 87us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.350040 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.350090 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.350135 (+ 45us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":36}
I20260928 20:18:49.350328 12536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.347546 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:35427 (local address 127.24.190.3:60541)
0928 20:18:49.347748 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.347765 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.347843 (+ 78us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.347994 (+ 151us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.347995 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.347997 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:49.348076 (+ 79us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.348078 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.348697 (+ 619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.348698 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.349446 (+ 748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.349448 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.350030 (+ 582us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.350030 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.350110 (+ 80us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.350113 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.350164 (+ 51us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.350193 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":187,"mutex_wait_us":25,"thread_start_us":102,"threads_started":1}
I20260928 20:18:49.350345 12526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.347623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:39847 (local address 127.24.190.1:39049)
0928 20:18:49.347667 (+ 44us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.347669 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.347688 (+ 19us) server_negotiation.cc:407] Connection header received
0928 20:18:49.347717 (+ 29us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.347718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.347728 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.347809 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:49.347979 (+ 170us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.348493 (+ 514us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.349473 (+ 980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.349843 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.349941 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.349950 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.350133 (+ 183us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.350242 (+ 109us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:18:49.350381 12525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.347644 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:60541 (local address 127.24.190.2:35427)
0928 20:18:49.347701 (+ 57us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.347703 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.347836 (+ 133us) server_negotiation.cc:407] Connection header received
0928 20:18:49.347904 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.347905 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.347918 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.347992 (+ 74us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:49.348150 (+ 158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.348608 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.349544 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.349944 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.350022 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.350031 (+ 9us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.350231 (+ 200us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.350275 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:18:49.350644 12196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9d4e0d5a934487689e59731c1360be5" candidate_uuid: "b88c313194fd4a9d8284580aae48a164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7b37119a52f48448e31d4753355eb21" is_pre_election: true
I20260928 20:18:49.350728 12330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9d4e0d5a934487689e59731c1360be5" candidate_uuid: "b88c313194fd4a9d8284580aae48a164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8df9faf420485494cbcf432067d2a1" is_pre_election: true
I20260928 20:18:49.350850 12196 raft_consensus.cc:2454] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88c313194fd4a9d8284580aae48a164 in term 0.
I20260928 20:18:49.350893 12330 raft_consensus.cc:2454] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b88c313194fd4a9d8284580aae48a164 in term 0.
I20260928 20:18:49.351085 12397 leader_election.cc:302] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88c313194fd4a9d8284580aae48a164, e7b37119a52f48448e31d4753355eb21; no voters:
I20260928 20:18:49.351217 12534 raft_consensus.cc:2781] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:49.351279 12534 raft_consensus.cc:482] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:49.351295 12534 raft_consensus.cc:3037] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:49.351998 12534 raft_consensus.cc:504] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.352141 12534 leader_election.cc:288] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [CANDIDATE]: Term 1 election: Requested vote from peers e7b37119a52f48448e31d4753355eb21 (127.24.190.1:39049), af8df9faf420485494cbcf432067d2a1 (127.24.190.2:35427)
I20260928 20:18:49.352299 12196 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9d4e0d5a934487689e59731c1360be5" candidate_uuid: "b88c313194fd4a9d8284580aae48a164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e7b37119a52f48448e31d4753355eb21"
I20260928 20:18:49.352381 12196 raft_consensus.cc:3037] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:49.352427 12330 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e9d4e0d5a934487689e59731c1360be5" candidate_uuid: "b88c313194fd4a9d8284580aae48a164" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af8df9faf420485494cbcf432067d2a1"
I20260928 20:18:49.352552 12330 raft_consensus.cc:3037] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:49.353199 12196 raft_consensus.cc:2454] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88c313194fd4a9d8284580aae48a164 in term 1.
I20260928 20:18:49.353396 12397 leader_election.cc:302] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b88c313194fd4a9d8284580aae48a164, e7b37119a52f48448e31d4753355eb21; no voters:
I20260928 20:18:49.353484 12534 raft_consensus.cc:2781] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:49.353540 12330 raft_consensus.cc:2454] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b88c313194fd4a9d8284580aae48a164 in term 1.
I20260928 20:18:49.353634 12534 raft_consensus.cc:686] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 1 LEADER]: Becoming Leader. State: Replica: b88c313194fd4a9d8284580aae48a164, State: Running, Role: LEADER
I20260928 20:18:49.353726 12534 consensus_queue.cc:237] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } }
I20260928 20:18:49.354620 12050 catalog_manager.cc:5495] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 reported cstate change: term changed from 0 to 1, leader changed from <none> to b88c313194fd4a9d8284580aae48a164 (127.24.190.3). New cstate: current_term: 1 leader_uuid: "b88c313194fd4a9d8284580aae48a164" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b88c313194fd4a9d8284580aae48a164" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 34359 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 } health_report { overall_health: UNKNOWN } } }
I20260928 20:18:49.401160 12524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.398250 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50288 (local address 127.24.190.3:34359)
0928 20:18:49.398336 (+ 86us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.398338 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.398348 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:18:49.398415 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.398416 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.398435 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.398496 (+ 61us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:49.398735 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.399202 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.400051 (+ 849us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.400359 (+ 308us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.400435 (+ 76us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.400633 (+ 198us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:49.400790 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:49.400881 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.400996 (+ 115us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.401023 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260928 20:18:49.403055 12196 raft_consensus.cc:1261] T e9d4e0d5a934487689e59731c1360be5 P e7b37119a52f48448e31d4753355eb21 [term 1 FOLLOWER]: Refusing update from remote peer b88c313194fd4a9d8284580aae48a164: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:49.403055 12330 raft_consensus.cc:1261] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 1 FOLLOWER]: Refusing update from remote peer b88c313194fd4a9d8284580aae48a164: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:49.403687 12537 consensus_queue.cc:1035] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e7b37119a52f48448e31d4753355eb21" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 39049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:49.403828 12534 consensus_queue.cc:1035] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af8df9faf420485494cbcf432067d2a1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35427 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:49.406503 12540 mvcc.cc:205] Tried to move back new op lower bound from 7334407083632119808 to 7334407083433525248. Current Snapshot: MvccSnapshot[applied={T|T < 7334407083632119808}]
I20260928 20:18:49.406988 12541 mvcc.cc:205] Tried to move back new op lower bound from 7334407083632119808 to 7334407083433525248. Current Snapshot: MvccSnapshot[applied={T|T < 7334407083632119808}]
I20260928 20:18:49.408995 12050 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:49.409094 12050 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41962:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:49.409986 12050 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 909b75581c8947ecb00875d089261023: Sending DeleteTablet for 3 replicas of tablet e9d4e0d5a934487689e59731c1360be5
I20260928 20:18:49.410475 12444 tablet_service.cc:1514] Processing DeleteTablet for tablet e9d4e0d5a934487689e59731c1360be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:50278
I20260928 20:18:49.410511 12176 tablet_service.cc:1514] Processing DeleteTablet for tablet e9d4e0d5a934487689e59731c1360be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:48206
I20260928 20:18:49.410532 12310 tablet_service.cc:1514] Processing DeleteTablet for tablet e9d4e0d5a934487689e59731c1360be5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:49 UTC) from {username='kudu', principal='kudu/127.24.190.62@KRBTEST.COM'} at 127.0.0.1:59246
I20260928 20:18:49.410909 12550 tablet_replica.cc:330] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: stopping tablet replica
I20260928 20:18:49.410921 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12113
I20260928 20:18:49.411026 12550 raft_consensus.cc:2229] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:18:49.411168 12550 raft_consensus.cc:2258] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:49.411839 12550 ts_tablet_manager.cc:1905] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:49.414044 12550 ts_tablet_manager.cc:1918] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:49.414142 12550 log.cc:1196] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/e9d4e0d5a934487689e59731c1360be5
I20260928 20:18:49.414479 12550 ts_tablet_manager.cc:1939] T e9d4e0d5a934487689e59731c1360be5 P b88c313194fd4a9d8284580aae48a164: Deleting consensus metadata
I20260928 20:18:49.414906 12037 catalog_manager.cc:4841] TS b88c313194fd4a9d8284580aae48a164 (127.24.190.3:34359): tablet e9d4e0d5a934487689e59731c1360be5 (table test-table [id=556d465358f940cb993430e767ac654a]) successfully deleted
I20260928 20:18:49.418392 12551 tablet_replica.cc:330] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: stopping tablet replica
I20260928 20:18:49.418529 12551 raft_consensus.cc:2229] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:49.418687 12551 raft_consensus.cc:2258] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:49.419212 12551 ts_tablet_manager.cc:1905] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:49.421573 12551 ts_tablet_manager.cc:1918] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:49.421662 12551 log.cc:1196] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/e9d4e0d5a934487689e59731c1360be5
I20260928 20:18:49.421957 12551 ts_tablet_manager.cc:1939] T e9d4e0d5a934487689e59731c1360be5 P af8df9faf420485494cbcf432067d2a1: Deleting consensus metadata
I20260928 20:18:49.422489 12038 catalog_manager.cc:4841] TS af8df9faf420485494cbcf432067d2a1 (127.24.190.2:35427): tablet e9d4e0d5a934487689e59731c1360be5 (table test-table [id=556d465358f940cb993430e767ac654a]) successfully deleted
W20260928 20:18:49.422881 12035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:39049 (error 108)
I20260928 20:18:49.423467 12521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.423330 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:39049 (local address 127.0.0.1:48210)
0928 20:18:49.423388 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.423431 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:39049: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260928 20:18:49.423565 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12247
W20260928 20:18:49.424600 12035 catalog_manager.cc:4584] TS e7b37119a52f48448e31d4753355eb21 (127.24.190.1:39049): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet e9d4e0d5a934487689e59731c1360be5: Network error: Client connection negotiation failed: client connection to 127.24.190.1:39049: connect: Connection refused (error 111)
I20260928 20:18:49.429538 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12381
I20260928 20:18:49.435294 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12019
2026-09-28T20:18:49Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (2235 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-09-28T20:18:49Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:49Z Disabled control of system clock
I20260928 20:18:49.462960 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:40593
--webserver_interface=127.24.190.62
--webserver_port=0
--builtin_ntp_servers=127.24.190.20:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:40593
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:49.543381 12557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:49.543598 12557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:49.543619 12557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:49.544710 12557 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:49.544747 12557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:49.544759 12557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:49.544772 12557 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:49.544785 12557 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:49.546077 12557 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:40593
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:40593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12557
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:49.546345 12557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:49.546665 12557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:49.551755 12563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.551813 12562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.551813 12565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:49.551859 12557 server_base.cc:1034] running on GCE node
I20260928 20:18:49.552245 12557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:49.552498 12557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:49.553669 12557 hybrid_clock.cc:648] HybridClock initialized: now 1790626729553653 us; error 27 us; skew 500 ppm
I20260928 20:18:49.555138 12557 webserver.cc:460] Webserver started at http://127.24.190.62:37943/ using document root <none> and password file <none>
I20260928 20:18:49.555408 12557 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:49.555483 12557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:49.555629 12557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:49.556768 12557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "2eb692436b8c4a549847541113844811"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "dfd54882fbf8a11f420f737a44fdd515"
server_key_iv: "46b99d2b0669b0ee74866525f13e5f90"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.557119 12557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "2eb692436b8c4a549847541113844811"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "dfd54882fbf8a11f420f737a44fdd515"
server_key_iv: "46b99d2b0669b0ee74866525f13e5f90"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.558535 12557 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:49.559273 12571 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.559574 12557 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:49.559670 12557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "2eb692436b8c4a549847541113844811"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "dfd54882fbf8a11f420f737a44fdd515"
server_key_iv: "46b99d2b0669b0ee74866525f13e5f90"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.559739 12557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:49.588297 12557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:49.588629 12557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:49.588773 12557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:49.592624 12557 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:40593
I20260928 20:18:49.592664 12623 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:40593 every 8 connection(s)
I20260928 20:18:49.593034 12557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:49.594024 12624 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:49.596369 12624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811: Bootstrap starting.
I20260928 20:18:49.596958 12624 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:49.597272 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12557
I20260928 20:18:49.597319 12624 log.cc:824] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:49.597383 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:49.597589 25336 external_mini_cluster.cc:1428] Setting key f5ff62a8d1d28b35682559506ed7ff3f
I20260928 20:18:49.598176 12624 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811: No bootstrap required, opened a new log
I20260928 20:18:49.599879 12624 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb692436b8c4a549847541113844811" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40593 } }
I20260928 20:18:49.600013 12624 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:49.600034 12624 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2eb692436b8c4a549847541113844811, State: Initialized, Role: FOLLOWER
I20260928 20:18:49.600195 12624 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb692436b8c4a549847541113844811" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40593 } }
I20260928 20:18:49.600303 12624 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:49.600361 12624 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:49.600438 12624 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:49.601274 12624 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb692436b8c4a549847541113844811" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40593 } }
I20260928 20:18:49.601399 12624 leader_election.cc:302] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2eb692436b8c4a549847541113844811; no voters:
I20260928 20:18:49.601598 12624 leader_election.cc:288] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:49.601666 12629 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:49.601824 12629 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [term 1 LEADER]: Becoming Leader. State: Replica: 2eb692436b8c4a549847541113844811, State: Running, Role: LEADER
I20260928 20:18:49.601861 12624 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:49.601907 12629 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb692436b8c4a549847541113844811" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40593 } }
I20260928 20:18:49.602238 12630 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2eb692436b8c4a549847541113844811" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb692436b8c4a549847541113844811" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40593 } } }
I20260928 20:18:49.602221 12629 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2eb692436b8c4a549847541113844811. Latest consensus state: current_term: 1 leader_uuid: "2eb692436b8c4a549847541113844811" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2eb692436b8c4a549847541113844811" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40593 } } }
I20260928 20:18:49.602432 12629 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:49.603195 12638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:49.603744 12638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:49.602422 12630 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:49.604947 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.598139 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33214 (local address 127.24.190.62:40593)
0928 20:18:49.598383 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.598390 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.598418 (+ 28us) server_negotiation.cc:407] Connection header received
0928 20:18:49.599882 (+ 1464us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.599890 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.599952 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.600135 (+ 183us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:49.600410 (+ 275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.601351 (+ 941us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.602587 (+ 1236us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.603197 (+ 610us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.603328 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.604237 (+ 909us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:49.604241 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:49.604241 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:49.604442 (+ 201us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:49.604487 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:49.604501 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:49.604572 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.604657 (+ 85us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.604735 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":164,"thread_start_us":89,"threads_started":1}
I20260928 20:18:49.605464 12638 catalog_manager.cc:1347] Generated new cluster ID: ed5fffb704af4a0e98c4dd040fa2c62b
I20260928 20:18:49.605510 12638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:49.635373 12638 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:49.635936 12638 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:49.643218 12638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811: Generated new TSK 0
I20260928 20:18:49.643427 12638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:49.648926 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.1:0
--local_ip_for_outbound_sockets=127.24.190.1
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40593
--builtin_ntp_servers=127.24.190.20:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:49.730785 12648 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:49.730984 12648 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:49.731006 12648 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:49.732172 12648 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:49.732214 12648 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:49.732240 12648 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.1
I20260928 20:18:49.733685 12648 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.1:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.24.190.1
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12648
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.1
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:49.733938 12648 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:49.734297 12648 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:49.739528 12656 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:49.739605 12648 server_base.cc:1034] running on GCE node
W20260928 20:18:49.739499 12654 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.739540 12653 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:49.739929 12648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:49.740154 12648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:49.741321 12648 hybrid_clock.cc:648] HybridClock initialized: now 1790626729741310 us; error 28 us; skew 500 ppm
I20260928 20:18:49.742621 12648 webserver.cc:460] Webserver started at http://127.24.190.1:37965/ using document root <none> and password file <none>
I20260928 20:18:49.742877 12648 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:49.742946 12648 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:49.743094 12648 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:49.744236 12648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data/instance:
uuid: "1f8623e886144aeb85cb10833c6788ef"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "c411f97ef0c63822a34a0bd49be7e450"
server_key_iv: "7563adbbc82a02e4cc2e1df4e5f18817"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.744601 12648 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance:
uuid: "1f8623e886144aeb85cb10833c6788ef"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "c411f97ef0c63822a34a0bd49be7e450"
server_key_iv: "7563adbbc82a02e4cc2e1df4e5f18817"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.745965 12648 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:18:49.746847 12662 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.747099 12648 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:49.747200 12648 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal
uuid: "1f8623e886144aeb85cb10833c6788ef"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "c411f97ef0c63822a34a0bd49be7e450"
server_key_iv: "7563adbbc82a02e4cc2e1df4e5f18817"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.747304 12648 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:49.756953 12648 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:49.757251 12648 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:49.757404 12648 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:49.757618 12648 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:49.757953 12648 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:49.758010 12648 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.758050 12648 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:49.758078 12648 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.764092 12648 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.1:46001
I20260928 20:18:49.764134 12775 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.1:46001 every 8 connection(s)
I20260928 20:18:49.764452 12648 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/data/info.pb
I20260928 20:18:49.769454 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.765204 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.1:46149 (local address 127.24.190.62:40593)
0928 20:18:49.765282 (+ 78us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.765284 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.765451 (+ 167us) server_negotiation.cc:407] Connection header received
0928 20:18:49.765912 (+ 461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.765914 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.765926 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.765993 (+ 67us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:49.766748 (+ 755us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.767241 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.768177 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.768368 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.768427 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.769189 (+ 762us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:49.769191 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:49.769191 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:49.769197 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:49.769212 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:49.769216 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:49.769269 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.769362 (+ 93us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.769388 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260928 20:18:49.769613 12778 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.765130 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:40593 (local address 127.24.190.1:46149)
0928 20:18:49.765328 (+ 198us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.765366 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.765824 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.766044 (+ 220us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.766047 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.766055 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:49.766658 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.766664 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.767327 (+ 663us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.767328 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.768098 (+ 770us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.768100 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.768448 (+ 348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.768449 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.768556 (+ 107us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.769052 (+ 496us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:49.769052 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:49.769080 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:49.769102 (+ 22us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:49.769292 (+ 190us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:49.769296 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:49.769299 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.769350 (+ 51us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.769427 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":110,"thread_start_us":77,"threads_started":1}
I20260928 20:18:49.770134 12776 heartbeater.cc:347] Connected to a master server at 127.24.190.62:40593
I20260928 20:18:49.770259 12776 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:49.770485 12776 heartbeater.cc:511] Master 127.24.190.62:40593 requested a full tablet report, sending...
I20260928 20:18:49.771046 12588 ts_manager.cc:194] Registered new tserver with Master: 1f8623e886144aeb85cb10833c6788ef (127.24.190.1:46001)
I20260928 20:18:49.771680 12588 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.1:46149
I20260928 20:18:49.774080 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12648
I20260928 20:18:49.774169 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-0/wal/instance
I20260928 20:18:49.774423 25336 external_mini_cluster.cc:1428] Setting key ee3bd354daec1208896021feb1cdce7a
I20260928 20:18:49.775367 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.2:0
--local_ip_for_outbound_sockets=127.24.190.2
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40593
--builtin_ntp_servers=127.24.190.20:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260928 20:18:49.856043 12779 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:49.856268 12779 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:49.856292 12779 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:49.857477 12779 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:49.857532 12779 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:49.857558 12779 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.2
I20260928 20:18:49.859018 12779 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.2:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.24.190.2
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12779
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.2
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:49.859285 12779 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:49.859596 12779 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:49.865001 12784 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.865065 12785 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.865001 12787 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:49.865373 12779 server_base.cc:1034] running on GCE node
I20260928 20:18:49.865600 12779 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:49.865847 12779 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:49.866997 12779 hybrid_clock.cc:648] HybridClock initialized: now 1790626729866981 us; error 34 us; skew 500 ppm
I20260928 20:18:49.868351 12779 webserver.cc:460] Webserver started at http://127.24.190.2:44905/ using document root <none> and password file <none>
I20260928 20:18:49.868611 12779 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:49.868687 12779 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:49.868837 12779 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:49.869920 12779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data/instance:
uuid: "74732b231c7a491ca0dea910239bd0f1"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "dc51fdd4d9cef33c2eb368fdd7f2cc27"
server_key_iv: "a0eb73fdcee43283f440954993f0ca75"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.870328 12779 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance:
uuid: "74732b231c7a491ca0dea910239bd0f1"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "dc51fdd4d9cef33c2eb368fdd7f2cc27"
server_key_iv: "a0eb73fdcee43283f440954993f0ca75"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.871680 12779 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:49.872411 12793 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.872575 12779 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:18:49.872670 12779 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal
uuid: "74732b231c7a491ca0dea910239bd0f1"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "dc51fdd4d9cef33c2eb368fdd7f2cc27"
server_key_iv: "a0eb73fdcee43283f440954993f0ca75"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.872750 12779 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:49.890873 12779 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:49.891211 12779 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:49.891379 12779 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:49.891624 12779 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:49.891957 12779 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:49.892010 12779 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.892043 12779 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:49.892071 12779 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.897689 12779 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.2:35181
I20260928 20:18:49.897730 12906 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.2:35181 every 8 connection(s)
I20260928 20:18:49.898052 12779 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/data/info.pb
I20260928 20:18:49.900260 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12779
I20260928 20:18:49.900388 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal/instance
I20260928 20:18:49.900596 25336 external_mini_cluster.cc:1428] Setting key f67bd7fef3e4d916049942d7fdd8e60d
I20260928 20:18:49.901692 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.24.190.3:0
--local_ip_for_outbound_sockets=127.24.190.3
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40593
--builtin_ntp_servers=127.24.190.20:43635
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260928 20:18:49.904395 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.898815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:48049 (local address 127.24.190.62:40593)
0928 20:18:49.898887 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:49.898889 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:49.899115 (+ 226us) server_negotiation.cc:407] Connection header received
0928 20:18:49.899657 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:49.899658 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:49.899670 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:49.899733 (+ 63us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:49.900444 (+ 711us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.901158 (+ 714us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.902757 (+ 1599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.903042 (+ 285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.903121 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.904032 (+ 911us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:49.904033 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:49.904034 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:49.904038 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:49.904057 (+ 19us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:49.904062 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:49.904119 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:49.904243 (+ 124us) server_negotiation.cc:299] Negotiation successful
0928 20:18:49.904282 (+ 39us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":44}
I20260928 20:18:49.904515 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:49.898793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:40593 (local address 127.24.190.2:48049)
0928 20:18:49.898997 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:49.899030 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:49.899542 (+ 512us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:49.899808 (+ 266us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:49.899812 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:49.899820 (+ 8us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:49.900322 (+ 502us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.900325 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.901246 (+ 921us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.901247 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.902676 (+ 1429us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:49.902680 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:49.903150 (+ 470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:49.903151 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:49.903298 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:49.903883 (+ 585us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:49.903883 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:49.903912 (+ 29us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:49.903935 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:49.904163 (+ 228us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:49.904167 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:49.904169 (+ 2us) client_negotiation.cc:769] Sending connection context
0928 20:18:49.904224 (+ 55us) client_negotiation.cc:240] Negotiation successful
0928 20:18:49.904306 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147,"thread_start_us":94,"threads_started":1}
I20260928 20:18:49.904994 12907 heartbeater.cc:347] Connected to a master server at 127.24.190.62:40593
I20260928 20:18:49.905097 12907 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:49.905303 12907 heartbeater.cc:511] Master 127.24.190.62:40593 requested a full tablet report, sending...
I20260928 20:18:49.905679 12588 ts_manager.cc:194] Registered new tserver with Master: 74732b231c7a491ca0dea910239bd0f1 (127.24.190.2:35181)
I20260928 20:18:49.906220 12588 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.2:48049
W20260928 20:18:49.983732 12910 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:49.983938 12910 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:49.983959 12910 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:49.985678 12910 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:49.985721 12910 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:49.985746 12910 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.190.3
I20260928 20:18:49.987052 12910 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43635
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.24.190.3:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.24.190.3
--webserver_port=0
--tserver_master_addrs=127.24.190.62:40593
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.12910
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.24.190.3
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:49.987242 12910 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:49.987489 12910 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:49.992436 12918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.992431 12915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:49.992431 12916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:49.992718 12910 server_base.cc:1034] running on GCE node
I20260928 20:18:49.992967 12910 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:49.993202 12910 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:49.994343 12910 hybrid_clock.cc:648] HybridClock initialized: now 1790626729994328 us; error 25 us; skew 500 ppm
I20260928 20:18:49.995659 12910 webserver.cc:460] Webserver started at http://127.24.190.3:46815/ using document root <none> and password file <none>
I20260928 20:18:49.995898 12910 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:49.995967 12910 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:49.996100 12910 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:49.997145 12910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data/instance:
uuid: "ce4d10ca514449ecb9013db25a2134e6"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "5d669bd83c2686d932c337eaa94c9bf7"
server_key_iv: "10b9b8a3ae016925f316d74feed0fbce"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.997507 12910 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance:
uuid: "ce4d10ca514449ecb9013db25a2134e6"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "5d669bd83c2686d932c337eaa94c9bf7"
server_key_iv: "10b9b8a3ae016925f316d74feed0fbce"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.998894 12910 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:49.999583 12924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:49.999775 12910 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:18:49.999878 12910 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal
uuid: "ce4d10ca514449ecb9013db25a2134e6"
format_stamp: "Formatted at 2026-09-28 20:18:49 on dist-test-slave-n45k"
server_key: "5d669bd83c2686d932c337eaa94c9bf7"
server_key_iv: "10b9b8a3ae016925f316d74feed0fbce"
server_key_version: "encryptionkey@0"
I20260928 20:18:49.999950 12910 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:50.024641 12910 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:50.024973 12910 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:50.025132 12910 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:50.025367 12910 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260928 20:18:50.025703 12910 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260928 20:18:50.025758 12910 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:50.025792 12910 ts_tablet_manager.cc:610] Registered 0 tablets
I20260928 20:18:50.025822 12910 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:50.031630 12910 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.3:46333
I20260928 20:18:50.031678 13037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.3:46333 every 8 connection(s)
I20260928 20:18:50.032007 12910 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/data/info.pb
I20260928 20:18:50.037431 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.032744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.3:58089 (local address 127.24.190.62:40593)
0928 20:18:50.032795 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.032798 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.033062 (+ 264us) server_negotiation.cc:407] Connection header received
0928 20:18:50.033670 (+ 608us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.033672 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.033684 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.033738 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:50.034495 (+ 757us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.034992 (+ 497us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.035993 (+ 1001us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.036189 (+ 196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.036274 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.037133 (+ 859us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:50.037135 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:50.037135 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:50.037140 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:50.037155 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:50.037161 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:50.037226 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.037324 (+ 98us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.037354 (+ 30us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:18:50.037652 13040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.032724 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:40593 (local address 127.24.190.3:58089)
0928 20:18:50.032914 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.032947 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:50.033489 (+ 542us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:50.033816 (+ 327us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:50.033820 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:50.033832 (+ 12us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:18:50.034398 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.034403 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.035083 (+ 680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.035084 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.035886 (+ 802us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.035888 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.036272 (+ 384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.036273 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.036415 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.036977 (+ 562us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0928 20:18:50.036977 (+ 0us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:18:50.037005 (+ 28us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0928 20:18:50.037028 (+ 23us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:18:50.037227 (+ 199us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:18:50.037233 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:18:50.037236 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:50.037308 (+ 72us) client_negotiation.cc:240] Negotiation successful
0928 20:18:50.037408 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":125,"thread_start_us":75,"threads_started":1}
I20260928 20:18:50.037746 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 12910
I20260928 20:18:50.037866 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal/instance
I20260928 20:18:50.038066 25336 external_mini_cluster.cc:1428] Setting key 774cb1f2160cacf318e91dc08366b1dd
I20260928 20:18:50.038092 13038 heartbeater.cc:347] Connected to a master server at 127.24.190.62:40593
I20260928 20:18:50.038195 13038 heartbeater.cc:464] Registering TS with master...
I20260928 20:18:50.038411 13038 heartbeater.cc:511] Master 127.24.190.62:40593 requested a full tablet report, sending...
I20260928 20:18:50.038826 12588 ts_manager.cc:194] Registered new tserver with Master: ce4d10ca514449ecb9013db25a2134e6 (127.24.190.3:46333)
I20260928 20:18:50.039101 25336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260928 20:18:50.039305 12588 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.190.3:58089
I20260928 20:18:50.043179 12628 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.040525 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33226 (local address 127.24.190.62:40593)
0928 20:18:50.040562 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.040564 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.040669 (+ 105us) server_negotiation.cc:407] Connection header received
0928 20:18:50.040738 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.040739 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.040746 (+ 7us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.040791 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:50.040964 (+ 173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.041402 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.042124 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.042349 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.042411 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.042991 (+ 580us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:50.042992 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:50.042992 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:50.042996 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:50.043008 (+ 12us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:50.043011 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:50.043048 (+ 37us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.043088 (+ 40us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.043106 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
I20260928 20:18:50.044762 12588 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33226:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260928 20:18:50.046168 12588 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260928 20:18:50.052892 13048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.048570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.2:35181 (local address 127.0.0.1:44312)
0928 20:18:50.049108 (+ 538us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.049117 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:50.049165 (+ 48us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:50.049349 (+ 184us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:50.049350 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:50.049351 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:50.049383 (+ 32us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.049384 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.050722 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.050723 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.051637 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.051639 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.052573 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052574 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.052671 (+ 97us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.052685 (+ 14us) client_negotiation.cc:769] Sending connection context
0928 20:18:50.052755 (+ 70us) client_negotiation.cc:240] Negotiation successful
0928 20:18:50.052812 (+ 57us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"thread_start_us":124,"threads_started":1}
I20260928 20:18:50.052917 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.048829 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44312 (local address 127.24.190.2:35181)
0928 20:18:50.048953 (+ 124us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.048957 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.049166 (+ 209us) server_negotiation.cc:407] Connection header received
0928 20:18:50.049244 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.049247 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.049262 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.049337 (+ 75us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:50.049471 (+ 134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.050666 (+ 1195us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.051728 (+ 1062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.052463 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052544 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.052639 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.052784 (+ 145us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.052832 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94,"thread_start_us":68,"threads_started":1}
I20260928 20:18:50.053000 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.048688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33062 (local address 127.24.190.1:46001)
0928 20:18:50.048874 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.048880 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.048974 (+ 94us) server_negotiation.cc:407] Connection header received
0928 20:18:50.049090 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.049092 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.049110 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.049191 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:50.049431 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.050314 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.051845 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.052499 (+ 654us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052558 (+ 59us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.052639 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.052871 (+ 232us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.052912 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":151,"thread_start_us":77,"threads_started":1}
I20260928 20:18:50.053265 13049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.048679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57574 (local address 127.24.190.3:46333)
0928 20:18:50.048847 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.048851 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.048863 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:18:50.049107 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.049109 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.049129 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.049198 (+ 69us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:50.049436 (+ 238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.050577 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052043 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.052600 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052671 (+ 71us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.052813 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.053155 (+ 342us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.053192 (+ 37us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":77,"threads_started":1}
I20260928 20:18:50.053098 13046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.048523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:46333 (local address 127.0.0.1:57574)
0928 20:18:50.048683 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.048730 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:50.049008 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:50.049268 (+ 260us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:50.049271 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:50.049273 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:50.049354 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.049356 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.050670 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.050671 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.051870 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.051872 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.052849 (+ 977us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052850 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.052914 (+ 64us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.052918 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:18:50.052967 (+ 49us) client_negotiation.cc:240] Negotiation successful
0928 20:18:50.053011 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":2,"thread_start_us":61,"threads_started":1}
I20260928 20:18:50.053290 13047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.048523 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46001 (local address 127.0.0.1:33062)
0928 20:18:50.048912 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.048922 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:50.048984 (+ 62us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:50.049274 (+ 290us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:50.049275 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:50.049278 (+ 3us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:50.049369 (+ 91us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.049372 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.050401 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.050402 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.051758 (+ 1356us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.051761 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.052674 (+ 913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.052675 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.052759 (+ 84us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.052763 (+ 4us) client_negotiation.cc:769] Sending connection context
0928 20:18:50.053105 (+ 342us) client_negotiation.cc:240] Negotiation successful
0928 20:18:50.053155 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":374,"mutex_wait_us":48,"thread_start_us":75,"threads_started":1}
I20260928 20:18:50.054165 12972 tablet_service.cc:1467] Processing CreateTablet for tablet 3dc377f3eac2400eb8acb2b580abf933 (DEFAULT_TABLE table=test-table [id=a060be951698476f8c298d9c740e1ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:50.054195 12841 tablet_service.cc:1467] Processing CreateTablet for tablet 3dc377f3eac2400eb8acb2b580abf933 (DEFAULT_TABLE table=test-table [id=a060be951698476f8c298d9c740e1ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:50.054567 12972 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dc377f3eac2400eb8acb2b580abf933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:50.054601 12841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dc377f3eac2400eb8acb2b580abf933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:50.054695 12710 tablet_service.cc:1467] Processing CreateTablet for tablet 3dc377f3eac2400eb8acb2b580abf933 (DEFAULT_TABLE table=test-table [id=a060be951698476f8c298d9c740e1ccb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260928 20:18:50.054992 12710 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3dc377f3eac2400eb8acb2b580abf933. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:50.057336 13052 tablet_bootstrap.cc:492] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Bootstrap starting.
I20260928 20:18:50.057976 13052 tablet_bootstrap.cc:654] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:50.058014 13053 tablet_bootstrap.cc:492] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Bootstrap starting.
I20260928 20:18:50.058437 13052 log.cc:824] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:50.058835 13053 tablet_bootstrap.cc:654] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:50.058866 13054 tablet_bootstrap.cc:492] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: Bootstrap starting.
I20260928 20:18:50.059149 13053 log.cc:824] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:50.059279 13052 tablet_bootstrap.cc:492] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: No bootstrap required, opened a new log
I20260928 20:18:50.059350 13052 ts_tablet_manager.cc:1397] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:18:50.059628 13054 tablet_bootstrap.cc:654] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:50.059860 13053 tablet_bootstrap.cc:492] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: No bootstrap required, opened a new log
I20260928 20:18:50.059933 13053 ts_tablet_manager.cc:1397] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:18:50.059942 13054 log.cc:824] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:50.060806 13054 tablet_bootstrap.cc:492] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: No bootstrap required, opened a new log
I20260928 20:18:50.060876 13054 ts_tablet_manager.cc:1397] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s
I20260928 20:18:50.061614 13052 raft_consensus.cc:348] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.061889 13052 raft_consensus.cc:374] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:50.061939 13052 raft_consensus.cc:729] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74732b231c7a491ca0dea910239bd0f1, State: Initialized, Role: FOLLOWER
I20260928 20:18:50.062198 13052 consensus_queue.cc:260] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.062443 13058 raft_consensus.cc:482] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260928 20:18:50.062486 13052 ts_tablet_manager.cc:1428] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:18:50.062615 12907 heartbeater.cc:503] Master 127.24.190.62:40593 was elected leader, sending a full tablet report...
I20260928 20:18:50.062520 13053 raft_consensus.cc:348] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.062664 13053 raft_consensus.cc:374] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:50.062597 13058 raft_consensus.cc:504] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.062716 13053 raft_consensus.cc:729] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ce4d10ca514449ecb9013db25a2134e6, State: Initialized, Role: FOLLOWER
I20260928 20:18:50.062824 13053 consensus_queue.cc:260] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.063055 13053 ts_tablet_manager.cc:1428] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260928 20:18:50.063536 13038 heartbeater.cc:503] Master 127.24.190.62:40593 was elected leader, sending a full tablet report...
I20260928 20:18:50.063637 13054 raft_consensus.cc:348] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.063805 13054 raft_consensus.cc:374] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:50.063846 13054 raft_consensus.cc:729] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f8623e886144aeb85cb10833c6788ef, State: Initialized, Role: FOLLOWER
I20260928 20:18:50.063961 13054 consensus_queue.cc:260] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.064220 13054 ts_tablet_manager.cc:1428] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260928 20:18:50.064241 12776 heartbeater.cc:503] Master 127.24.190.62:40593 was elected leader, sending a full tablet report...
I20260928 20:18:50.064743 13058 leader_election.cc:288] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1f8623e886144aeb85cb10833c6788ef (127.24.190.1:46001), ce4d10ca514449ecb9013db25a2134e6 (127.24.190.3:46333)
I20260928 20:18:50.066529 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.063350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:33933 (local address 127.24.190.1:46001)
0928 20:18:50.063549 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.063551 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.063561 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:18:50.063585 (+ 24us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.063585 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.063608 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.063669 (+ 61us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:50.063811 (+ 142us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.064497 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.065712 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.066173 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.066236 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.066244 (+ 8us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.066438 (+ 194us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.066473 (+ 35us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":177}
I20260928 20:18:50.066529 12909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.063268 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46001 (local address 127.24.190.2:33933)
0928 20:18:50.063335 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.063348 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:50.063385 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:50.063676 (+ 291us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:50.063677 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:50.063679 (+ 2us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:50.063744 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.063745 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.064581 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.064582 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.065626 (+ 1044us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.065629 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.066273 (+ 644us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.066274 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.066368 (+ 94us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.066371 (+ 3us) client_negotiation.cc:769] Sending connection context
0928 20:18:50.066422 (+ 51us) client_negotiation.cc:240] Negotiation successful
0928 20:18:50.066463 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":48}
I20260928 20:18:50.066883 12730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc377f3eac2400eb8acb2b580abf933" candidate_uuid: "74732b231c7a491ca0dea910239bd0f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8623e886144aeb85cb10833c6788ef" is_pre_election: true
I20260928 20:18:50.067008 12730 raft_consensus.cc:2454] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74732b231c7a491ca0dea910239bd0f1 in term 0.
I20260928 20:18:50.067242 12794 leader_election.cc:302] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f8623e886144aeb85cb10833c6788ef, 74732b231c7a491ca0dea910239bd0f1; no voters:
I20260928 20:18:50.067353 13058 raft_consensus.cc:2781] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260928 20:18:50.067400 13058 raft_consensus.cc:482] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260928 20:18:50.067431 13058 raft_consensus.cc:3037] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:50.067924 13049 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.064718 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.24.190.2:43385 (local address 127.24.190.3:46333)
0928 20:18:50.064802 (+ 84us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.064804 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.064919 (+ 115us) server_negotiation.cc:407] Connection header received
0928 20:18:50.065001 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.065002 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.065011 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.065055 (+ 44us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0928 20:18:50.065210 (+ 155us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.065696 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.067106 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.067638 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.067695 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.067700 (+ 5us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.067857 (+ 157us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.067883 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":61}
I20260928 20:18:50.067978 13062 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.064571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.3:46333 (local address 127.24.190.2:43385)
0928 20:18:50.064807 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.064869 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0928 20:18:50.064942 (+ 73us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:18:50.065056 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:18:50.065057 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:18:50.065058 (+ 1us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0928 20:18:50.065126 (+ 68us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.065127 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.065788 (+ 661us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.065789 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.066976 (+ 1187us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:18:50.066978 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.067713 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.067714 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:18:50.067780 (+ 66us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.067785 (+ 5us) client_negotiation.cc:769] Sending connection context
0928 20:18:50.067848 (+ 63us) client_negotiation.cc:240] Negotiation successful
0928 20:18:50.067896 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219,"thread_start_us":69,"threads_started":1}
I20260928 20:18:50.068259 13058 raft_consensus.cc:504] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.068259 12992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc377f3eac2400eb8acb2b580abf933" candidate_uuid: "74732b231c7a491ca0dea910239bd0f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4d10ca514449ecb9013db25a2134e6" is_pre_election: true
I20260928 20:18:50.068387 13058 leader_election.cc:288] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [CANDIDATE]: Term 1 election: Requested vote from peers 1f8623e886144aeb85cb10833c6788ef (127.24.190.1:46001), ce4d10ca514449ecb9013db25a2134e6 (127.24.190.3:46333)
I20260928 20:18:50.068401 12992 raft_consensus.cc:2454] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 74732b231c7a491ca0dea910239bd0f1 in term 0.
I20260928 20:18:50.068508 12992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc377f3eac2400eb8acb2b580abf933" candidate_uuid: "74732b231c7a491ca0dea910239bd0f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ce4d10ca514449ecb9013db25a2134e6"
I20260928 20:18:50.068568 12992 raft_consensus.cc:3037] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:50.068528 12730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3dc377f3eac2400eb8acb2b580abf933" candidate_uuid: "74732b231c7a491ca0dea910239bd0f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f8623e886144aeb85cb10833c6788ef"
I20260928 20:18:50.068624 12730 raft_consensus.cc:3037] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:50.069264 12992 raft_consensus.cc:2454] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74732b231c7a491ca0dea910239bd0f1 in term 1.
I20260928 20:18:50.069279 12730 raft_consensus.cc:2454] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 74732b231c7a491ca0dea910239bd0f1 in term 1.
I20260928 20:18:50.069422 12794 leader_election.cc:302] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f8623e886144aeb85cb10833c6788ef, 74732b231c7a491ca0dea910239bd0f1; no voters:
I20260928 20:18:50.069514 13058 raft_consensus.cc:2781] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:50.069571 13058 raft_consensus.cc:686] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 1 LEADER]: Becoming Leader. State: Replica: 74732b231c7a491ca0dea910239bd0f1, State: Running, Role: LEADER
I20260928 20:18:50.069643 13058 consensus_queue.cc:237] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } }
I20260928 20:18:50.070479 12587 catalog_manager.cc:5495] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 74732b231c7a491ca0dea910239bd0f1 (127.24.190.2). New cstate: current_term: 1 leader_uuid: "74732b231c7a491ca0dea910239bd0f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "74732b231c7a491ca0dea910239bd0f1" member_type: VOTER last_known_addr { host: "127.24.190.2" port: 35181 } health_report { overall_health: HEALTHY } } }
I20260928 20:18:50.075453 13051 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.073114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44314 (local address 127.24.190.2:35181)
0928 20:18:50.073153 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:50.073155 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:50.073164 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:18:50.073208 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:50.073209 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:50.073224 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:50.073307 (+ 83us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:18:50.073414 (+ 107us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.073850 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.074676 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:50.074880 (+ 204us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:50.074959 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:50.075118 (+ 159us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:18:50.075214 (+ 96us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:18:50.075321 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:50.075344 (+ 23us) server_negotiation.cc:299] Negotiation successful
0928 20:18:50.075361 (+ 17us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:18:50.077104 12992 raft_consensus.cc:1261] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 1 FOLLOWER]: Refusing update from remote peer 74732b231c7a491ca0dea910239bd0f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:50.077104 12730 raft_consensus.cc:1261] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 1 FOLLOWER]: Refusing update from remote peer 74732b231c7a491ca0dea910239bd0f1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:18:50.077488 13058 consensus_queue.cc:1035] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ce4d10ca514449ecb9013db25a2134e6" member_type: VOTER last_known_addr { host: "127.24.190.3" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:50.077587 13059 consensus_queue.cc:1035] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f8623e886144aeb85cb10833c6788ef" member_type: VOTER last_known_addr { host: "127.24.190.1" port: 46001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:18:50.080299 13066 mvcc.cc:205] Tried to move back new op lower bound from 7334407086393556992 to 7334407086366035968. Current Snapshot: MvccSnapshot[applied={T|T < 7334407086393556992}]
I20260928 20:18:50.080547 13067 mvcc.cc:205] Tried to move back new op lower bound from 7334407086393556992 to 7334407086366035968. Current Snapshot: MvccSnapshot[applied={T|T < 7334407086393556992}]
I20260928 20:18:50.082674 12587 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:33226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:50.082774 12587 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:33226:
table { table_name: "test-table" } modify_external_catalogs: true
I20260928 20:18:50.083582 12587 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2eb692436b8c4a549847541113844811: Sending DeleteTablet for 3 replicas of tablet 3dc377f3eac2400eb8acb2b580abf933
I20260928 20:18:50.083925 12710 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dc377f3eac2400eb8acb2b580abf933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:50 UTC) from {username='slave'} at 127.0.0.1:33062
I20260928 20:18:50.083945 12841 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dc377f3eac2400eb8acb2b580abf933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:50 UTC) from {username='slave'} at 127.0.0.1:44312
I20260928 20:18:50.083984 12972 tablet_service.cc:1514] Processing DeleteTablet for tablet 3dc377f3eac2400eb8acb2b580abf933 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-09-28 20:18:50 UTC) from {username='slave'} at 127.0.0.1:57574
I20260928 20:18:50.084206 13075 tablet_replica.cc:330] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef: stopping tablet replica
I20260928 20:18:50.084283 13076 tablet_replica.cc:330] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: stopping tablet replica
I20260928 20:18:50.084309 13075 raft_consensus.cc:2229] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:50.084376 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12648
I20260928 20:18:50.084384 13076 raft_consensus.cc:2229] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 1 LEADER]: Raft consensus shutting down.
I20260928 20:18:50.084412 13075 raft_consensus.cc:2258] T 3dc377f3eac2400eb8acb2b580abf933 P 1f8623e886144aeb85cb10833c6788ef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:50.084939 13077 tablet_replica.cc:330] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: stopping tablet replica
I20260928 20:18:50.085026 13077 raft_consensus.cc:2229] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260928 20:18:50.085125 13077 raft_consensus.cc:2258] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:50.084508 13076 raft_consensus.cc:2258] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260928 20:18:50.085713 13077 ts_tablet_manager.cc:1905] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:50.086536 13076 ts_tablet_manager.cc:1905] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260928 20:18:50.087659 13077 ts_tablet_manager.cc:1918] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:50.087734 13077 log.cc:1196] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-2/wal/wals/3dc377f3eac2400eb8acb2b580abf933
I20260928 20:18:50.087982 13077 ts_tablet_manager.cc:1939] T 3dc377f3eac2400eb8acb2b580abf933 P ce4d10ca514449ecb9013db25a2134e6: Deleting consensus metadata
I20260928 20:18:50.088050 13076 ts_tablet_manager.cc:1918] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260928 20:18:50.088128 13076 log.cc:1196] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Deleting WAL directory at /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1790626483051462-25336-0/minicluster-data/ts-1/wal/wals/3dc377f3eac2400eb8acb2b580abf933
I20260928 20:18:50.088362 13076 ts_tablet_manager.cc:1939] T 3dc377f3eac2400eb8acb2b580abf933 P 74732b231c7a491ca0dea910239bd0f1: Deleting consensus metadata
I20260928 20:18:50.088431 12574 catalog_manager.cc:4841] TS ce4d10ca514449ecb9013db25a2134e6 (127.24.190.3:46333): tablet 3dc377f3eac2400eb8acb2b580abf933 (table test-table [id=a060be951698476f8c298d9c740e1ccb]) successfully deleted
I20260928 20:18:50.088986 12575 catalog_manager.cc:4841] TS 74732b231c7a491ca0dea910239bd0f1 (127.24.190.2:35181): tablet 3dc377f3eac2400eb8acb2b580abf933 (table test-table [id=a060be951698476f8c298d9c740e1ccb]) successfully deleted
W20260928 20:18:50.090832 12572 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.24.190.1:46001 (error 108)
I20260928 20:18:50.091605 13047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:50.091440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.1:46001 (local address 127.0.0.1:33064)
0928 20:18:50.091504 (+ 64us) negotiation.cc:107] Waiting for socket to connect
0928 20:18:50.091561 (+ 57us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.1:46001: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260928 20:18:50.091780 12572 catalog_manager.cc:4584] TS 1f8623e886144aeb85cb10833c6788ef (127.24.190.1:46001): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 3dc377f3eac2400eb8acb2b580abf933: Network error: Client connection negotiation failed: client connection to 127.24.190.1:46001: connect: Connection refused (error 111)
I20260928 20:18:50.094067 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12779
I20260928 20:18:50.100800 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12910
I20260928 20:18:50.105958 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 12557
2026-09-28T20:18:50Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (670 ms)
[----------] 6 tests from EncryptionPolicyTest (8793 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:50 dist-test-slave-n45k krb5kdc[13081](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:50 dist-test-slave-n45k krb5kdc[13081](info): set up 2 sockets
Sep 28 20:18:50 dist-test-slave-n45k krb5kdc[13081](info): commencing operation
krb5kdc: starting...
W20260928 20:18:51.155198 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.029s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:51 dist-test-slave-n45k krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:51.277801 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32877
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46021
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32877
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:51.361689 13094 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:51.361902 13094 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:51.361925 13094 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:51.363241 13094 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:51.363291 13094 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:51.363304 13094 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:51.363317 13094 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:51.363329 13094 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:51.364892 13094 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46021
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32877
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32877
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13094
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:51.365159 13094 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:51.365418 13094 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:51.370690 13100 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:51.370678 13099 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:51.370676 13102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:51.370970 13094 server_base.cc:1034] running on GCE node
I20260928 20:18:51.371192 13094 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:51.371488 13094 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:51.372663 13094 hybrid_clock.cc:648] HybridClock initialized: now 1790626731372638 us; error 51 us; skew 500 ppm
Sep 28 20:18:51 dist-test-slave-n45k krb5kdc[13081](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626731, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:51.375349 13094 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:51.375805 13094 webserver.cc:460] Webserver started at http://127.0.0.1:33863/ using document root <none> and password file <none>
I20260928 20:18:51.376046 13094 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:51.376112 13094 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:51.376259 13094 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:51.377342 13094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "b639f24826904b0da55c3e1eb03c470c"
format_stamp: "Formatted at 2026-09-28 20:18:51 on dist-test-slave-n45k"
server_key: "7d8a54b2c24a6808dabdb5d735d1e854"
server_key_iv: "4edf89d5f3ffa29e352e11a758df9867"
server_key_version: "encryptionkey@0"
I20260928 20:18:51.377753 13094 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "b639f24826904b0da55c3e1eb03c470c"
format_stamp: "Formatted at 2026-09-28 20:18:51 on dist-test-slave-n45k"
server_key: "7d8a54b2c24a6808dabdb5d735d1e854"
server_key_iv: "4edf89d5f3ffa29e352e11a758df9867"
server_key_version: "encryptionkey@0"
I20260928 20:18:51.379344 13094 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:51.380294 13109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:51.380530 13094 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:51.380637 13094 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "b639f24826904b0da55c3e1eb03c470c"
format_stamp: "Formatted at 2026-09-28 20:18:51 on dist-test-slave-n45k"
server_key: "7d8a54b2c24a6808dabdb5d735d1e854"
server_key_iv: "4edf89d5f3ffa29e352e11a758df9867"
server_key_version: "encryptionkey@0"
I20260928 20:18:51.380746 13094 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:51.393405 13094 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:51.396023 13094 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:51.396181 13094 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:51.400120 13094 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32877
I20260928 20:18:51.400171 13161 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32877 every 8 connection(s)
I20260928 20:18:51.400527 13094 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:51.401499 13162 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:51.402901 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13094
I20260928 20:18:51.403007 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:51.403205 25336 external_mini_cluster.cc:1428] Setting key 57a07e98e8604222f0979ffd1ffbc27e
I20260928 20:18:51.404311 13162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c: Bootstrap starting.
I20260928 20:18:51.405021 13162 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:51.405366 13162 log.cc:824] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:51.406095 13162 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c: No bootstrap required, opened a new log
I20260928 20:18:51.408404 13162 raft_consensus.cc:348] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b639f24826904b0da55c3e1eb03c470c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32877 } }
I20260928 20:18:51.408548 13162 raft_consensus.cc:374] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:51.408569 13162 raft_consensus.cc:729] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b639f24826904b0da55c3e1eb03c470c, State: Initialized, Role: FOLLOWER
I20260928 20:18:51.408699 13162 consensus_queue.cc:260] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b639f24826904b0da55c3e1eb03c470c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32877 } }
I20260928 20:18:51.408783 13162 raft_consensus.cc:388] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:51.408818 13162 raft_consensus.cc:482] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:51.408874 13162 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:51.409647 13162 raft_consensus.cc:504] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b639f24826904b0da55c3e1eb03c470c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32877 } }
I20260928 20:18:51.409765 13162 leader_election.cc:302] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b639f24826904b0da55c3e1eb03c470c; no voters:
I20260928 20:18:51.409964 13162 leader_election.cc:288] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:51.409986 13167 raft_consensus.cc:2781] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:51.410105 13167 raft_consensus.cc:686] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [term 1 LEADER]: Becoming Leader. State: Replica: b639f24826904b0da55c3e1eb03c470c, State: Running, Role: LEADER
I20260928 20:18:51.410188 13167 consensus_queue.cc:237] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b639f24826904b0da55c3e1eb03c470c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32877 } }
I20260928 20:18:51.410243 13162 sys_catalog.cc:564] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [sys.catalog]: configured and running, proceeding with master startup.
Sep 28 20:18:51 dist-test-slave-n45k krb5kdc[13081](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626731, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 20:18:51.410518 13167 sys_catalog.cc:455] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b639f24826904b0da55c3e1eb03c470c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b639f24826904b0da55c3e1eb03c470c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32877 } } }
I20260928 20:18:51.410640 13167 sys_catalog.cc:458] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:51.410534 13168 sys_catalog.cc:455] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [sys.catalog]: SysCatalogTable state changed. Reason: New leader b639f24826904b0da55c3e1eb03c470c. Latest consensus state: current_term: 1 leader_uuid: "b639f24826904b0da55c3e1eb03c470c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b639f24826904b0da55c3e1eb03c470c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32877 } } }
I20260928 20:18:51.410940 13168 sys_catalog.cc:458] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:51.411897 13173 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:51.412783 13173 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:51.414497 13173 catalog_manager.cc:1347] Generated new cluster ID: e197de44d7ea412490a7a374580ccb02
I20260928 20:18:51.414553 13173 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:51.415208 13165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:51.403755 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58113 (local address 127.0.0.1:32877)
0928 20:18:51.403943 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:51.403950 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:51.403974 (+ 24us) server_negotiation.cc:407] Connection header received
0928 20:18:51.404448 (+ 474us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:51.404456 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:51.404503 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:51.404617 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:51.405500 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:51.406587 (+ 1087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:51.407653 (+ 1066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:51.408056 (+ 403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:51.408137 (+ 81us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:51.411294 (+ 3157us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:51.411299 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:51.411300 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:51.411312 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:51.413357 (+ 2045us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:51.413773 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:51.413776 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:51.413777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:51.413889 (+ 112us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:51.414314 (+ 425us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:51.414315 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:51.414315 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:51.414660 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:51.414807 (+ 147us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:51.414954 (+ 147us) server_negotiation.cc:299] Negotiation successful
0928 20:18:51.415053 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":89,"threads_started":1}
I20260928 20:18:51.416244 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:51.424721 13165 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:51.417599 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36597 (local address 127.0.0.1:32877)
0928 20:18:51.417634 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:51.417636 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:51.418485 (+ 849us) server_negotiation.cc:407] Connection header received
0928 20:18:51.418566 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:51.418567 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:51.418577 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:51.418632 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:51.419230 (+ 598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:51.419731 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:51.420453 (+ 722us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:51.420675 (+ 222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:51.420752 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:51.421989 (+ 1237us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:51.421990 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:51.421990 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:51.422004 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:51.423493 (+ 1489us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:51.423893 (+ 400us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:51.423894 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:51.423894 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:51.423948 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:51.424193 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:51.424194 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:51.424195 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:51.424305 (+ 110us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:51.424418 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:51.424545 (+ 127us) server_negotiation.cc:299] Negotiation successful
0928 20:18:51.424605 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:18:51.437925 13173 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:51.438589 13173 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:51.445103 13173 catalog_manager.cc:5868] T 00000000000000000000000000000000 P b639f24826904b0da55c3e1eb03c470c: Generated new TSK 0
I20260928 20:18:51.445343 13173 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:51.450992 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13094
W20260928 20:18:51.455364 13079 connection.cc:535] client connection to 127.0.0.1:32877 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:32877): Connection reset by peer (error 104)
2026-09-28T20:18:51Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (1343 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:51 dist-test-slave-n45k krb5kdc[13193](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:51 dist-test-slave-n45k krb5kdc[13193](info): set up 2 sockets
Sep 28 20:18:51 dist-test-slave-n45k krb5kdc[13193](info): commencing operation
krb5kdc: starting...
W20260928 20:18:52.522722 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.054s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:52 dist-test-slave-n45k krb5kdc[13193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626732, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:52.646687 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44449
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:33999
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44449
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:52.727249 13206 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:52.727522 13206 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:52.727563 13206 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:52.728880 13206 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:52.728950 13206 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:52.728976 13206 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:52.729001 13206 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:52.729033 13206 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:52.730544 13206 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:33999
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44449
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44449
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13206
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:52.730819 13206 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:52.731047 13206 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:52.736235 13212 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:52.736292 13214 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:52.736312 13211 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:52.736445 13206 server_base.cc:1034] running on GCE node
I20260928 20:18:52.736786 13206 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:52.737088 13206 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:52.738327 13206 hybrid_clock.cc:648] HybridClock initialized: now 1790626732738323 us; error 44 us; skew 500 ppm
Sep 28 20:18:52 dist-test-slave-n45k krb5kdc[13193](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626732, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:52.741449 13206 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:52.741891 13206 webserver.cc:460] Webserver started at http://127.0.0.1:45227/ using document root <none> and password file <none>
I20260928 20:18:52.742192 13206 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:52.742268 13206 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:52.742445 13206 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:52.743506 13206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "bcec3c2f91644d838a92ff249c4fbb1b"
format_stamp: "Formatted at 2026-09-28 20:18:52 on dist-test-slave-n45k"
server_key: "f1fb4f063d8a142772f221aea5a2b9ea"
server_key_iv: "6038627008dca9c06ed61a9e4bcc3ad3"
server_key_version: "encryptionkey@0"
I20260928 20:18:52.743865 13206 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "bcec3c2f91644d838a92ff249c4fbb1b"
format_stamp: "Formatted at 2026-09-28 20:18:52 on dist-test-slave-n45k"
server_key: "f1fb4f063d8a142772f221aea5a2b9ea"
server_key_iv: "6038627008dca9c06ed61a9e4bcc3ad3"
server_key_version: "encryptionkey@0"
I20260928 20:18:52.745267 13206 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:52.746066 13221 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:52.746321 13206 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:52.746430 13206 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "bcec3c2f91644d838a92ff249c4fbb1b"
format_stamp: "Formatted at 2026-09-28 20:18:52 on dist-test-slave-n45k"
server_key: "f1fb4f063d8a142772f221aea5a2b9ea"
server_key_iv: "6038627008dca9c06ed61a9e4bcc3ad3"
server_key_version: "encryptionkey@0"
I20260928 20:18:52.746515 13206 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:52.771131 13206 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:52.773130 13206 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:52.773315 13206 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:52.777473 13206 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44449
I20260928 20:18:52.777544 13273 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44449 every 8 connection(s)
I20260928 20:18:52.777912 13206 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:52.778851 13274 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:52.781111 13274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b: Bootstrap starting.
I20260928 20:18:52.781688 13274 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:52.781754 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13206
I20260928 20:18:52.781899 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:52.782014 13274 log.cc:824] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:52.782235 25336 external_mini_cluster.cc:1428] Setting key dbd1652c17a03e0d58d80b848f8893c0
I20260928 20:18:52.782830 13274 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b: No bootstrap required, opened a new log
I20260928 20:18:52.784436 13274 raft_consensus.cc:348] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44449 } }
I20260928 20:18:52.784564 13274 raft_consensus.cc:374] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:52.784585 13274 raft_consensus.cc:729] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bcec3c2f91644d838a92ff249c4fbb1b, State: Initialized, Role: FOLLOWER
I20260928 20:18:52.784744 13274 consensus_queue.cc:260] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44449 } }
I20260928 20:18:52.784827 13274 raft_consensus.cc:388] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:52.784865 13274 raft_consensus.cc:482] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:52.784924 13274 raft_consensus.cc:3037] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:52.785652 13274 raft_consensus.cc:504] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44449 } }
I20260928 20:18:52.785760 13274 leader_election.cc:302] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bcec3c2f91644d838a92ff249c4fbb1b; no voters:
I20260928 20:18:52.785899 13274 leader_election.cc:288] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:52.785969 13279 raft_consensus.cc:2781] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:52.786114 13274 sys_catalog.cc:564] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:52.786242 13279 raft_consensus.cc:686] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [term 1 LEADER]: Becoming Leader. State: Replica: bcec3c2f91644d838a92ff249c4fbb1b, State: Running, Role: LEADER
I20260928 20:18:52.786366 13279 consensus_queue.cc:237] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44449 } }
I20260928 20:18:52.786688 13281 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44449 } } }
I20260928 20:18:52.786780 13281 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:52.786679 13279 sys_catalog.cc:455] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [sys.catalog]: SysCatalogTable state changed. Reason: New leader bcec3c2f91644d838a92ff249c4fbb1b. Latest consensus state: current_term: 1 leader_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bcec3c2f91644d838a92ff249c4fbb1b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44449 } } }
I20260928 20:18:52.786955 13279 sys_catalog.cc:458] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:52.787084 13288 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:52.787784 13288 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:52.789738 13288 catalog_manager.cc:1347] Generated new cluster ID: d30e1014580f4d09b576c77bc1a9165d
I20260928 20:18:52.789791 13288 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:52.790228 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:52.782777 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55825 (local address 127.0.0.1:44449)
0928 20:18:52.782992 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:52.783000 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:52.783033 (+ 33us) server_negotiation.cc:407] Connection header received
0928 20:18:52.784430 (+ 1397us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:52.784438 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:52.784491 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:52.784651 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:52.784925 (+ 274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:52.786707 (+ 1782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:52.787945 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:52.788539 (+ 594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:52.788611 (+ 72us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:52.789537 (+ 926us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:52.789542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:52.789542 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:52.789747 (+ 205us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:52.789795 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:52.789810 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:52.789898 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:52.789994 (+ 96us) server_negotiation.cc:299] Negotiation successful
0928 20:18:52.790022 (+ 28us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":167,"thread_start_us":100,"threads_started":1}
I20260928 20:18:52.791355 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:52.796286 13278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:52.792766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33199 (local address 127.0.0.1:44449)
0928 20:18:52.792796 (+ 30us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:52.792798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:52.792913 (+ 115us) server_negotiation.cc:407] Connection header received
0928 20:18:52.792967 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:52.792968 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:52.792978 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:52.793043 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:52.793174 (+ 131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:52.793886 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:52.794914 (+ 1028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:52.795253 (+ 339us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:52.795330 (+ 77us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:52.796035 (+ 705us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:52.796036 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:52.796037 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:52.796041 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:52.796057 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:52.796061 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:52.796126 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:52.796198 (+ 72us) server_negotiation.cc:299] Negotiation successful
0928 20:18:52.796211 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15}
I20260928 20:18:52.810390 13288 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:52.811127 13288 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:52.816740 13288 catalog_manager.cc:5868] T 00000000000000000000000000000000 P bcec3c2f91644d838a92ff249c4fbb1b: Generated new TSK 0
I20260928 20:18:52.816949 13288 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:52.823589 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13206
W20260928 20:18:52.828080 13191 connection.cc:535] client connection to 127.0.0.1:44449 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44449): Connection reset by peer (error 104)
2026-09-28T20:18:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (1372 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:52 dist-test-slave-n45k krb5kdc[13305](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:52 dist-test-slave-n45k krb5kdc[13305](info): set up 2 sockets
Sep 28 20:18:52 dist-test-slave-n45k krb5kdc[13305](info): commencing operation
krb5kdc: starting...
W20260928 20:18:53.862816 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:53 dist-test-slave-n45k krb5kdc[13305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626733, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:53.982437 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45719
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43579
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45719
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:54.065269 13318 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:54.065546 13318 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:54.065583 13318 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:54.066793 13318 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:54.066875 13318 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:54.066898 13318 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:54.066918 13318 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:54.066946 13318 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:54.068521 13318 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43579
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45719
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45719
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13318
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:54.068806 13318 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:54.069042 13318 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:54.074580 13326 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:54.074647 13324 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:54.074640 13323 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:54.074955 13318 server_base.cc:1034] running on GCE node
I20260928 20:18:54.075292 13318 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:54.075593 13318 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:54.076785 13318 hybrid_clock.cc:648] HybridClock initialized: now 1790626734076771 us; error 29 us; skew 500 ppm
Sep 28 20:18:54 dist-test-slave-n45k krb5kdc[13305](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626734, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:54.079445 13318 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:54.079944 13318 webserver.cc:460] Webserver started at http://127.0.0.1:44947/ using document root <none> and password file <none>
I20260928 20:18:54.080209 13318 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:54.080282 13318 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:54.080435 13318 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:54.081491 13318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "e3593034cd1f4c04ac8f2e01c49847f6"
format_stamp: "Formatted at 2026-09-28 20:18:54 on dist-test-slave-n45k"
server_key: "cf8197c0a0ba5741bdbdc855f0100ec4"
server_key_iv: "175152d54d4b83fb2cda87601d75e4ac"
server_key_version: "encryptionkey@0"
I20260928 20:18:54.081884 13318 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "e3593034cd1f4c04ac8f2e01c49847f6"
format_stamp: "Formatted at 2026-09-28 20:18:54 on dist-test-slave-n45k"
server_key: "cf8197c0a0ba5741bdbdc855f0100ec4"
server_key_iv: "175152d54d4b83fb2cda87601d75e4ac"
server_key_version: "encryptionkey@0"
I20260928 20:18:54.083305 13318 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:18:54.084110 13333 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:54.084297 13318 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:54.084404 13318 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "e3593034cd1f4c04ac8f2e01c49847f6"
format_stamp: "Formatted at 2026-09-28 20:18:54 on dist-test-slave-n45k"
server_key: "cf8197c0a0ba5741bdbdc855f0100ec4"
server_key_iv: "175152d54d4b83fb2cda87601d75e4ac"
server_key_version: "encryptionkey@0"
I20260928 20:18:54.084478 13318 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:54.087992 13318 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:54.089936 13318 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:54.090099 13318 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:54.094008 13318 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45719
I20260928 20:18:54.094038 13385 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45719 every 8 connection(s)
I20260928 20:18:54.094452 13318 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:54.095422 13386 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:54.097143 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13318
I20260928 20:18:54.097259 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:54.097436 25336 external_mini_cluster.cc:1428] Setting key e5abbdea8a907d6b9797e27fda3a24ee
I20260928 20:18:54.097903 13386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6: Bootstrap starting.
I20260928 20:18:54.098560 13386 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:54.098873 13386 log.cc:824] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:54.099817 13386 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6: No bootstrap required, opened a new log
I20260928 20:18:54.100171 13389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:54.097989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41071 (local address 127.0.0.1:45719)
0928 20:18:54.098197 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:54.098206 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:54.098243 (+ 37us) server_negotiation.cc:407] Connection header received
0928 20:18:54.098795 (+ 552us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:54.098803 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:54.098835 (+ 32us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:54.099005 (+ 170us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:54.099689 (+ 684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:54.099694 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:54.099694 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:54.099698 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:54.099743 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:54.099757 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:54.099854 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:54.099942 (+ 88us) server_negotiation.cc:299] Negotiation successful
0928 20:18:54.099984 (+ 42us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":156,"thread_start_us":119,"threads_started":1}
I20260928 20:18:54.101183 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:54.101888 13386 raft_consensus.cc:348] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260928 20:18:54.102013 13386 raft_consensus.cc:374] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:54.102034 13386 raft_consensus.cc:729] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3593034cd1f4c04ac8f2e01c49847f6, State: Initialized, Role: FOLLOWER
I20260928 20:18:54.102171 13386 consensus_queue.cc:260] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260928 20:18:54.102277 13386 raft_consensus.cc:388] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:54.102351 13386 raft_consensus.cc:482] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:54.102401 13386 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:54.103137 13386 raft_consensus.cc:504] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260928 20:18:54.103250 13386 leader_election.cc:302] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e3593034cd1f4c04ac8f2e01c49847f6; no voters:
I20260928 20:18:54.103431 13386 leader_election.cc:288] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:54.103487 13396 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:54.103626 13389 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:54.102568 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37859 (local address 127.0.0.1:45719)
0928 20:18:54.102628 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:54.102630 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:54.102720 (+ 90us) server_negotiation.cc:407] Connection header received
0928 20:18:54.102746 (+ 26us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:54.102746 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:54.102750 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:54.102816 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:54.103366 (+ 550us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:54.103367 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:54.103367 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:54.103371 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:54.103387 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:54.103391 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:54.103452 (+ 61us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:54.103552 (+ 100us) server_negotiation.cc:299] Negotiation successful
0928 20:18:54.103567 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260928 20:18:54.103668 13396 raft_consensus.cc:686] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [term 1 LEADER]: Becoming Leader. State: Replica: e3593034cd1f4c04ac8f2e01c49847f6, State: Running, Role: LEADER
I20260928 20:18:54.103670 13386 sys_catalog.cc:564] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:54.103768 13396 consensus_queue.cc:237] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } }
I20260928 20:18:54.104251 13396 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e3593034cd1f4c04ac8f2e01c49847f6. Latest consensus state: current_term: 1 leader_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } } }
I20260928 20:18:54.104346 13396 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:54.104262 13397 sys_catalog.cc:455] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e3593034cd1f4c04ac8f2e01c49847f6" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45719 } } }
I20260928 20:18:54.104681 13397 sys_catalog.cc:458] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:54.104674 13403 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:54.105214 13403 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:54.106815 13403 catalog_manager.cc:1347] Generated new cluster ID: fe3265e2a08644e092714e50f5a47348
I20260928 20:18:54.106869 13403 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:54.121526 13403 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:54.121717 13403 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:54.127589 13403 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e3593034cd1f4c04ac8f2e01c49847f6: Generated new TSK 0
I20260928 20:18:54.127792 13403 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:54.131747 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13318
2026-09-28T20:18:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (1307 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:54 dist-test-slave-n45k krb5kdc[13417](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:54 dist-test-slave-n45k krb5kdc[13417](info): set up 2 sockets
Sep 28 20:18:54 dist-test-slave-n45k krb5kdc[13417](info): commencing operation
krb5kdc: starting...
W20260928 20:18:55.198786 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.049s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:55 dist-test-slave-n45k krb5kdc[13417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:55.321166 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35763
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44119
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35763
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:55.404898 13430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:55.405159 13430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:55.405207 13430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:55.406414 13430 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:55.406486 13430 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:55.406512 13430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:55.406561 13430 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:55.406595 13430 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:55.408113 13430 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44119
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35763
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:55.408383 13430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:55.408613 13430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:55.413700 13436 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:55.413647 13435 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:55.413673 13438 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:55.413842 13430 server_base.cc:1034] running on GCE node
I20260928 20:18:55.414090 13430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:55.414456 13430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:55.415624 13430 hybrid_clock.cc:648] HybridClock initialized: now 1790626735415614 us; error 38 us; skew 500 ppm
Sep 28 20:18:55 dist-test-slave-n45k krb5kdc[13417](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626735, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:55.418239 13430 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:55.418736 13430 webserver.cc:460] Webserver started at http://127.0.0.1:34775/ using document root <none> and password file <none>
I20260928 20:18:55.418974 13430 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:55.419041 13430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:55.419190 13430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:55.420284 13430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8"
format_stamp: "Formatted at 2026-09-28 20:18:55 on dist-test-slave-n45k"
server_key: "a9a970732900eca7fccf4865ea1b361f"
server_key_iv: "eda40fc960d930a7ec236cecd7f0dc4f"
server_key_version: "encryptionkey@0"
I20260928 20:18:55.420637 13430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8"
format_stamp: "Formatted at 2026-09-28 20:18:55 on dist-test-slave-n45k"
server_key: "a9a970732900eca7fccf4865ea1b361f"
server_key_iv: "eda40fc960d930a7ec236cecd7f0dc4f"
server_key_version: "encryptionkey@0"
I20260928 20:18:55.421993 13430 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:55.422775 13445 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:55.423012 13430 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:55.423136 13430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8"
format_stamp: "Formatted at 2026-09-28 20:18:55 on dist-test-slave-n45k"
server_key: "a9a970732900eca7fccf4865ea1b361f"
server_key_iv: "eda40fc960d930a7ec236cecd7f0dc4f"
server_key_version: "encryptionkey@0"
I20260928 20:18:55.423226 13430 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:55.438536 13430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:55.440917 13430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:55.441087 13430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:55.445585 13430 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35763
I20260928 20:18:55.445634 13497 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35763 every 8 connection(s)
I20260928 20:18:55.445983 13430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:55.446174 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13430
I20260928 20:18:55.446307 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:55.446511 25336 external_mini_cluster.cc:1428] Setting key 83835a59032ac68dd6e5624fc0311c35
I20260928 20:18:55.447053 13498 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:55.450217 13498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8: Bootstrap starting.
I20260928 20:18:55.450837 13498 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:55.451120 13498 log.cc:824] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:55.451831 13498 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8: No bootstrap required, opened a new log
Sep 28 20:18:55 dist-test-slave-n45k krb5kdc[13417](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626735, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 20:18:55.454094 13498 raft_consensus.cc:348] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35763 } }
I20260928 20:18:55.454232 13498 raft_consensus.cc:374] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:55.454255 13498 raft_consensus.cc:729] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51ca1537e96f49d0a9ba1dad4ccd77e8, State: Initialized, Role: FOLLOWER
I20260928 20:18:55.454423 13498 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35763 } }
I20260928 20:18:55.454514 13498 raft_consensus.cc:388] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:55.454573 13498 raft_consensus.cc:482] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:55.454625 13498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:55.455327 13498 raft_consensus.cc:504] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35763 } }
I20260928 20:18:55.455454 13498 leader_election.cc:302] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 51ca1537e96f49d0a9ba1dad4ccd77e8; no voters:
I20260928 20:18:55.455638 13498 leader_election.cc:288] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:55.455669 13503 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:55.455785 13503 raft_consensus.cc:686] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [term 1 LEADER]: Becoming Leader. State: Replica: 51ca1537e96f49d0a9ba1dad4ccd77e8, State: Running, Role: LEADER
I20260928 20:18:55.455917 13498 sys_catalog.cc:564] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:55.455919 13503 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35763 } }
I20260928 20:18:55.456400 13505 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51ca1537e96f49d0a9ba1dad4ccd77e8. Latest consensus state: current_term: 1 leader_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35763 } } }
I20260928 20:18:55.456552 13505 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:55.456831 13512 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:55.457401 13512 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:55.457423 13504 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "51ca1537e96f49d0a9ba1dad4ccd77e8" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35763 } } }
I20260928 20:18:55.457604 13504 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:55.458330 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:55.447104 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34245 (local address 127.0.0.1:35763)
0928 20:18:55.447287 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:55.447296 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:55.447331 (+ 35us) server_negotiation.cc:407] Connection header received
0928 20:18:55.447850 (+ 519us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:55.447859 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:55.447922 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:55.448077 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:55.448693 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:55.450102 (+ 1409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:55.450986 (+ 884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:55.451518 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:55.451642 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:55.454564 (+ 2922us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:55.454572 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:55.454572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:55.454582 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:55.456558 (+ 1976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:55.456998 (+ 440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:55.457001 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:55.457001 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:55.457095 (+ 94us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:55.457308 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:55.457309 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:55.457310 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:55.457641 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:55.457776 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:55.457947 (+ 171us) server_negotiation.cc:299] Negotiation successful
0928 20:18:55.458088 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":136,"thread_start_us":90,"threads_started":1}
I20260928 20:18:55.459110 13512 catalog_manager.cc:1347] Generated new cluster ID: 8d5e05d143fa47afa23e6bbabe810ddd
I20260928 20:18:55.459161 13512 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:55.459280 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:55.466995 13501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:55.460629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49071 (local address 127.0.0.1:35763)
0928 20:18:55.460667 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:55.460668 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:55.460786 (+ 118us) server_negotiation.cc:407] Connection header received
0928 20:18:55.460849 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:55.460850 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:55.460859 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:55.460915 (+ 56us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:55.461425 (+ 510us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:55.461977 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:55.462816 (+ 839us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:55.463031 (+ 215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:55.463101 (+ 70us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:55.464315 (+ 1214us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:55.464316 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:55.464317 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:55.464323 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:55.465881 (+ 1558us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:55.466205 (+ 324us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:55.466206 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:55.466207 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:55.466260 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:55.466476 (+ 216us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:55.466478 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:55.466478 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:55.466591 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:55.466702 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:55.466816 (+ 114us) server_negotiation.cc:299] Negotiation successful
0928 20:18:55.466890 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:18:55.475131 13512 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:55.475718 13512 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:55.478365 13512 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 51ca1537e96f49d0a9ba1dad4ccd77e8: Generated new TSK 0
I20260928 20:18:55.478533 13512 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:55.484030 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13430
2026-09-28T20:18:55Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (1352 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:55 dist-test-slave-n45k krb5kdc[13529](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:55 dist-test-slave-n45k krb5kdc[13529](info): set up 2 sockets
Sep 28 20:18:55 dist-test-slave-n45k krb5kdc[13529](info): commencing operation
krb5kdc: starting...
W20260928 20:18:56.527199 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.025s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:56 dist-test-slave-n45k krb5kdc[13529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626736, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:56Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:56.651768 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39673
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45957
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:56.733744 13542 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:56.733955 13542 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:56.733978 13542 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:56.735210 13542 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:56.735263 13542 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:56.735280 13542 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:56.735292 13542 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:56.735304 13542 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:56.736814 13542 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45957
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39673
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13542
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:56.737066 13542 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:56.737288 13542 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:56.742383 13548 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:56.742395 13550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:56.742429 13542 server_base.cc:1034] running on GCE node
W20260928 20:18:56.742426 13547 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:56.742813 13542 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:56.743103 13542 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:56.744261 13542 hybrid_clock.cc:648] HybridClock initialized: now 1790626736744248 us; error 43 us; skew 500 ppm
Sep 28 20:18:56 dist-test-slave-n45k krb5kdc[13529](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626736, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:56.750077 13542 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:56.750579 13542 webserver.cc:460] Webserver started at http://127.0.0.1:33477/ using document root <none> and password file <none>
I20260928 20:18:56.750784 13542 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:56.750830 13542 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:56.750927 13542 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:56.752107 13542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "07ef2596d70047bd9fb8aadc91c9df96"
format_stamp: "Formatted at 2026-09-28 20:18:56 on dist-test-slave-n45k"
server_key: "488d78933510931c020461ea096b7b5f"
server_key_iv: "abb552d5c97ce53d8290d8f0214a3ef1"
server_key_version: "encryptionkey@0"
I20260928 20:18:56.752452 13542 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "07ef2596d70047bd9fb8aadc91c9df96"
format_stamp: "Formatted at 2026-09-28 20:18:56 on dist-test-slave-n45k"
server_key: "488d78933510931c020461ea096b7b5f"
server_key_iv: "abb552d5c97ce53d8290d8f0214a3ef1"
server_key_version: "encryptionkey@0"
I20260928 20:18:56.753860 13542 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:56.754774 13557 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:56.754966 13542 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:18:56.755053 13542 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "07ef2596d70047bd9fb8aadc91c9df96"
format_stamp: "Formatted at 2026-09-28 20:18:56 on dist-test-slave-n45k"
server_key: "488d78933510931c020461ea096b7b5f"
server_key_iv: "abb552d5c97ce53d8290d8f0214a3ef1"
server_key_version: "encryptionkey@0"
I20260928 20:18:56.755131 13542 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:56.764930 13542 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:56.767057 13542 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:56.767318 13542 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:56.771198 13542 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39673
I20260928 20:18:56.771267 13609 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39673 every 8 connection(s)
I20260928 20:18:56.771590 13542 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:56.772542 13610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:56.774956 13610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96: Bootstrap starting.
I20260928 20:18:56.775518 13610 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:56.775763 13610 log.cc:824] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:56.776460 13610 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96: No bootstrap required, opened a new log
I20260928 20:18:56.777191 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13542
I20260928 20:18:56.777315 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:56.777511 25336 external_mini_cluster.cc:1428] Setting key 62a752b91f3ab936282e4bc023415175
I20260928 20:18:56.778708 13610 raft_consensus.cc:348] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ef2596d70047bd9fb8aadc91c9df96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39673 } }
I20260928 20:18:56.778894 13610 raft_consensus.cc:374] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:56.778973 13610 raft_consensus.cc:729] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07ef2596d70047bd9fb8aadc91c9df96, State: Initialized, Role: FOLLOWER
I20260928 20:18:56.779140 13610 consensus_queue.cc:260] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ef2596d70047bd9fb8aadc91c9df96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39673 } }
I20260928 20:18:56.779239 13610 raft_consensus.cc:388] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:56.779281 13610 raft_consensus.cc:482] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:56.779335 13610 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:56.779956 13610 raft_consensus.cc:504] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ef2596d70047bd9fb8aadc91c9df96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39673 } }
I20260928 20:18:56.780048 13610 leader_election.cc:302] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 07ef2596d70047bd9fb8aadc91c9df96; no voters:
I20260928 20:18:56.780279 13610 leader_election.cc:288] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:56.780304 13615 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:56.780417 13615 raft_consensus.cc:686] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [term 1 LEADER]: Becoming Leader. State: Replica: 07ef2596d70047bd9fb8aadc91c9df96, State: Running, Role: LEADER
I20260928 20:18:56.780553 13610 sys_catalog.cc:564] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:56.780567 13615 consensus_queue.cc:237] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ef2596d70047bd9fb8aadc91c9df96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39673 } }
I20260928 20:18:56.781087 13616 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "07ef2596d70047bd9fb8aadc91c9df96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ef2596d70047bd9fb8aadc91c9df96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39673 } } }
I20260928 20:18:56.781349 13616 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:56.781265 13617 sys_catalog.cc:455] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 07ef2596d70047bd9fb8aadc91c9df96. Latest consensus state: current_term: 1 leader_uuid: "07ef2596d70047bd9fb8aadc91c9df96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "07ef2596d70047bd9fb8aadc91c9df96" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39673 } } }
I20260928 20:18:56.781638 13617 sys_catalog.cc:458] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:56.781845 13624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:56.782485 13624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:56.784330 13614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:56.778020 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50717 (local address 127.0.0.1:39673)
0928 20:18:56.778287 (+ 267us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:56.778297 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:56.778333 (+ 36us) server_negotiation.cc:407] Connection header received
0928 20:18:56.778670 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:56.778679 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:56.778746 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:56.778901 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:56.779195 (+ 294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:56.780701 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:56.781877 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:56.782580 (+ 703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:56.782681 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:56.783562 (+ 881us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:56.783566 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:56.783566 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:56.783790 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:56.783829 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:56.783844 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:56.783912 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:56.784016 (+ 104us) server_negotiation.cc:299] Negotiation successful
0928 20:18:56.784121 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":162,"threads_started":1}
I20260928 20:18:56.785444 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:56.786670 13624 catalog_manager.cc:1347] Generated new cluster ID: 085f783cacbb4f75aab26ee40faf4a65
I20260928 20:18:56.786722 13624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:56.790655 13614 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:56.786978 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38191 (local address 127.0.0.1:39673)
0928 20:18:56.787018 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:56.787019 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:56.787312 (+ 293us) server_negotiation.cc:407] Connection header received
0928 20:18:56.787373 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:56.787374 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:56.787385 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:56.787439 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:56.787557 (+ 118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:56.788261 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:56.789329 (+ 1068us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:56.789622 (+ 293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:56.789697 (+ 75us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:56.790410 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:56.790412 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:56.790412 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:56.790418 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:56.790433 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:56.790438 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:56.790498 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:56.790557 (+ 59us) server_negotiation.cc:299] Negotiation successful
0928 20:18:56.790580 (+ 23us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:18:56.795526 13624 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:56.796231 13624 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:56.806049 13624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 07ef2596d70047bd9fb8aadc91c9df96: Generated new TSK 0
I20260928 20:18:56.806344 13624 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:56.809566 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13542
2026-09-28T20:18:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (1325 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:56 dist-test-slave-n45k krb5kdc[13641](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:56 dist-test-slave-n45k krb5kdc[13641](info): set up 2 sockets
Sep 28 20:18:56 dist-test-slave-n45k krb5kdc[13641](info): commencing operation
krb5kdc: starting...
W20260928 20:18:57.862823 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.035s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:57 dist-test-slave-n45k krb5kdc[13641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626737, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:57Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:57.981220 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41497
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:46073
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:58.061860 13654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:58.062095 13654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:58.062134 13654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:58.063279 13654 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:58.063345 13654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:58.063369 13654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:58.063390 13654 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:58.063427 13654 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:58.064872 13654 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:46073
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41497
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13654
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:58.065132 13654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:58.065366 13654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:58.070382 13660 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:58.070369 13659 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:58.070358 13662 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:58.070396 13654 server_base.cc:1034] running on GCE node
I20260928 20:18:58.070897 13654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:58.071197 13654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:58.072381 13654 hybrid_clock.cc:648] HybridClock initialized: now 1790626738072380 us; error 44 us; skew 500 ppm
Sep 28 20:18:58 dist-test-slave-n45k krb5kdc[13641](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626738, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:58.075011 13654 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:58.075470 13654 webserver.cc:460] Webserver started at http://127.0.0.1:41535/ using document root <none> and password file <none>
I20260928 20:18:58.075670 13654 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:58.075712 13654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:58.075799 13654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:58.076828 13654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "e16d450a521d4419a418dc375005bfd2"
format_stamp: "Formatted at 2026-09-28 20:18:58 on dist-test-slave-n45k"
server_key: "f932c78ad57d3492a2d2aded829f92b2"
server_key_iv: "6b74ea178de6480510b2f9fc8fae8a66"
server_key_version: "encryptionkey@0"
I20260928 20:18:58.077162 13654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "e16d450a521d4419a418dc375005bfd2"
format_stamp: "Formatted at 2026-09-28 20:18:58 on dist-test-slave-n45k"
server_key: "f932c78ad57d3492a2d2aded829f92b2"
server_key_iv: "6b74ea178de6480510b2f9fc8fae8a66"
server_key_version: "encryptionkey@0"
I20260928 20:18:58.078538 13654 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:18:58.079348 13669 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:58.079545 13654 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:18:58.079631 13654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "e16d450a521d4419a418dc375005bfd2"
format_stamp: "Formatted at 2026-09-28 20:18:58 on dist-test-slave-n45k"
server_key: "f932c78ad57d3492a2d2aded829f92b2"
server_key_iv: "6b74ea178de6480510b2f9fc8fae8a66"
server_key_version: "encryptionkey@0"
I20260928 20:18:58.079700 13654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:58.083071 13654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:58.085474 13654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:58.085634 13654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:58.089955 13654 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41497
I20260928 20:18:58.089988 13721 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41497 every 8 connection(s)
I20260928 20:18:58.090437 13654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:58.091432 13722 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:58.093700 13722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2: Bootstrap starting.
I20260928 20:18:58.094254 13722 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:58.094568 13722 log.cc:824] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:58.095369 13722 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2: No bootstrap required, opened a new log
I20260928 20:18:58.095693 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13654
I20260928 20:18:58.095805 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:58.095994 25336 external_mini_cluster.cc:1428] Setting key d318eda0ff571eb888f887c7a8b5b898
I20260928 20:18:58.097610 13722 raft_consensus.cc:348] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16d450a521d4419a418dc375005bfd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41497 } }
I20260928 20:18:58.097801 13722 raft_consensus.cc:374] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:58.097852 13722 raft_consensus.cc:729] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e16d450a521d4419a418dc375005bfd2, State: Initialized, Role: FOLLOWER
I20260928 20:18:58.097988 13722 consensus_queue.cc:260] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16d450a521d4419a418dc375005bfd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41497 } }
I20260928 20:18:58.098096 13722 raft_consensus.cc:388] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:58.098145 13722 raft_consensus.cc:482] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:58.098196 13722 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:58.098551 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:58.096486 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59191 (local address 127.0.0.1:41497)
0928 20:18:58.096722 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:58.096730 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:58.096755 (+ 25us) server_negotiation.cc:407] Connection header received
0928 20:18:58.097277 (+ 522us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:58.097283 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:58.097309 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:58.097453 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:58.098105 (+ 652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:58.098109 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:58.098109 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:58.098114 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:58.098166 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:58.098179 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:58.098237 (+ 58us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:58.098357 (+ 120us) server_negotiation.cc:299] Negotiation successful
0928 20:18:58.098398 (+ 41us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":100,"threads_started":1}
I20260928 20:18:58.099325 13722 raft_consensus.cc:504] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16d450a521d4419a418dc375005bfd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41497 } }
I20260928 20:18:58.099438 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:58.099455 13722 leader_election.cc:302] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e16d450a521d4419a418dc375005bfd2; no voters:
I20260928 20:18:58.099646 13722 leader_election.cc:288] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:58.099671 13727 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:58.099776 13727 raft_consensus.cc:686] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [term 1 LEADER]: Becoming Leader. State: Replica: e16d450a521d4419a418dc375005bfd2, State: Running, Role: LEADER
I20260928 20:18:58.099902 13722 sys_catalog.cc:564] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:58.099907 13727 consensus_queue.cc:237] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16d450a521d4419a418dc375005bfd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41497 } }
I20260928 20:18:58.100330 13727 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e16d450a521d4419a418dc375005bfd2. Latest consensus state: current_term: 1 leader_uuid: "e16d450a521d4419a418dc375005bfd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16d450a521d4419a418dc375005bfd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41497 } } }
I20260928 20:18:58.100595 13727 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:58.100492 13728 sys_catalog.cc:455] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e16d450a521d4419a418dc375005bfd2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e16d450a521d4419a418dc375005bfd2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41497 } } }
I20260928 20:18:58.100984 13740 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:58.101018 13728 sys_catalog.cc:458] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2 [sys.catalog]: This master's current role is: LEADER
I20260928 20:18:58.101457 13740 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:58.102936 13726 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:58.101554 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34095 (local address 127.0.0.1:41497)
0928 20:18:58.101587 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:58.101589 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:58.101952 (+ 363us) server_negotiation.cc:407] Connection header received
0928 20:18:58.101998 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:58.101999 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:58.102004 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:58.102076 (+ 72us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:58.102708 (+ 632us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:58.102709 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:58.102709 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:18:58.102714 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:58.102728 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:18:58.102733 (+ 5us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:58.102789 (+ 56us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:58.102861 (+ 72us) server_negotiation.cc:299] Negotiation successful
0928 20:18:58.102875 (+ 14us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:18:58.103384 13740 catalog_manager.cc:1347] Generated new cluster ID: 8cb82a4f79804433ad5c0bbcdca1420e
I20260928 20:18:58.103432 13740 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:58.113897 13740 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:58.114065 13740 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:58.120817 13740 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e16d450a521d4419a418dc375005bfd2: Generated new TSK 0
I20260928 20:18:58.121003 13740 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:58.123943 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13654
2026-09-28T20:18:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (1314 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:58 dist-test-slave-n45k krb5kdc[13753](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:58 dist-test-slave-n45k krb5kdc[13753](info): set up 2 sockets
Sep 28 20:18:58 dist-test-slave-n45k krb5kdc[13753](info): commencing operation
krb5kdc: starting...
W20260928 20:18:59.206842 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.064s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:18:59 dist-test-slave-n45k krb5kdc[13753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:18:59Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:18:59Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:18:59.329433 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43137
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41257
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:43137
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:18:59.409813 13766 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:18:59.410022 13766 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:18:59.410044 13766 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:18:59.411180 13766 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:18:59.411216 13766 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:18:59.411229 13766 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:18:59.411242 13766 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:18:59.411254 13766 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:18:59.412655 13766 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41257
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:43137
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:43137
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13766
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:18:59.412849 13766 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:18:59.413017 13766 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:18:59.418021 13772 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:59.418001 13771 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:18:59.418001 13774 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:18:59.418376 13766 server_base.cc:1034] running on GCE node
I20260928 20:18:59.418614 13766 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:18:59.418901 13766 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:18:59.420055 13766 hybrid_clock.cc:648] HybridClock initialized: now 1790626739420051 us; error 44 us; skew 500 ppm
Sep 28 20:18:59 dist-test-slave-n45k krb5kdc[13753](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626739, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:18:59.422555 13766 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:18:59.423053 13766 webserver.cc:460] Webserver started at http://127.0.0.1:39135/ using document root <none> and password file <none>
I20260928 20:18:59.423277 13766 fs_manager.cc:359] Metadata directory not provided
I20260928 20:18:59.423352 13766 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:18:59.423501 13766 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:18:59.424588 13766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "6e92749d13e94c879e945dc429517271"
format_stamp: "Formatted at 2026-09-28 20:18:59 on dist-test-slave-n45k"
server_key: "4a52dd91a93d1d775e9f5a1251649971"
server_key_iv: "2e3f7250e639aaf6ba0f5dc6a2afb534"
server_key_version: "encryptionkey@0"
I20260928 20:18:59.424944 13766 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "6e92749d13e94c879e945dc429517271"
format_stamp: "Formatted at 2026-09-28 20:18:59 on dist-test-slave-n45k"
server_key: "4a52dd91a93d1d775e9f5a1251649971"
server_key_iv: "2e3f7250e639aaf6ba0f5dc6a2afb534"
server_key_version: "encryptionkey@0"
I20260928 20:18:59.426329 13766 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:18:59.427147 13781 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:18:59.427353 13766 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:18:59.427453 13766 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "6e92749d13e94c879e945dc429517271"
format_stamp: "Formatted at 2026-09-28 20:18:59 on dist-test-slave-n45k"
server_key: "4a52dd91a93d1d775e9f5a1251649971"
server_key_iv: "2e3f7250e639aaf6ba0f5dc6a2afb534"
server_key_version: "encryptionkey@0"
I20260928 20:18:59.427538 13766 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:18:59.434692 13766 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:18:59.436391 13766 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:18:59.436542 13766 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:18:59.440701 13766 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:43137
I20260928 20:18:59.440732 13833 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:43137 every 8 connection(s)
I20260928 20:18:59.441099 13766 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:18:59.441938 13834 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:18:59.444006 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13766
I20260928 20:18:59.444135 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:18:59.444327 25336 external_mini_cluster.cc:1428] Setting key 6078f7bb8317375d74b570387b4eb35b
I20260928 20:18:59.444639 13834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271: Bootstrap starting.
I20260928 20:18:59.445330 13834 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271: Neither blocks nor log segments found. Creating new log.
I20260928 20:18:59.445611 13834 log.cc:824] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271: Log is configured to *not* fsync() on all Append() calls
I20260928 20:18:59.446439 13834 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271: No bootstrap required, opened a new log
I20260928 20:18:59.448472 13834 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92749d13e94c879e945dc429517271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43137 } }
I20260928 20:18:59.448638 13834 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:18:59.448683 13834 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e92749d13e94c879e945dc429517271, State: Initialized, Role: FOLLOWER
I20260928 20:18:59.448812 13834 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92749d13e94c879e945dc429517271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43137 } }
I20260928 20:18:59.448915 13834 raft_consensus.cc:388] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:18:59.448959 13834 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:18:59.449007 13834 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:18:59.449626 13834 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92749d13e94c879e945dc429517271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43137 } }
I20260928 20:18:59.449754 13834 leader_election.cc:302] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6e92749d13e94c879e945dc429517271; no voters:
I20260928 20:18:59.449901 13834 leader_election.cc:288] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:18:59.449925 13839 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:18:59.450038 13839 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [term 1 LEADER]: Becoming Leader. State: Replica: 6e92749d13e94c879e945dc429517271, State: Running, Role: LEADER
I20260928 20:18:59.450109 13839 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92749d13e94c879e945dc429517271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43137 } }
I20260928 20:18:59.450166 13834 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:18:59.451359 13839 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e92749d13e94c879e945dc429517271. Latest consensus state: current_term: 1 leader_uuid: "6e92749d13e94c879e945dc429517271" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92749d13e94c879e945dc429517271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43137 } } }
I20260928 20:18:59.451365 13840 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6e92749d13e94c879e945dc429517271" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6e92749d13e94c879e945dc429517271" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 43137 } } }
I20260928 20:18:59.451692 13840 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [sys.catalog]: This master's current role is: LEADER
Sep 28 20:18:59 dist-test-slave-n45k krb5kdc[13753](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626739, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 20:18:59.451555 13839 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271 [sys.catalog]: This master's current role is: LEADER
W20260928 20:18:59.452649 13854 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:18:59.452710 13854 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:18:59.452759 13848 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:18:59.452905 13848 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:18:59.456348 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:59.444880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:35353 (local address 127.0.0.1:43137)
0928 20:18:59.445044 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:59.445052 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:59.445151 (+ 99us) server_negotiation.cc:407] Connection header received
0928 20:18:59.445632 (+ 481us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:59.445639 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:59.445717 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:59.445877 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:59.446662 (+ 785us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:59.447658 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:59.448789 (+ 1131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:59.449358 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:59.449444 (+ 86us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:59.452318 (+ 2874us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:59.452322 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:59.452322 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:59.452334 (+ 12us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:59.454727 (+ 2393us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:59.455195 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:59.455198 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:59.455198 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:59.455278 (+ 80us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:59.455522 (+ 244us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:59.455522 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:59.455522 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:59.455753 (+ 231us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:59.455853 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:59.456021 (+ 168us) server_negotiation.cc:299] Negotiation successful
0928 20:18:59.456100 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":84,"threads_started":1}
I20260928 20:18:59.457345 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:18:59.459326 13848 catalog_manager.cc:1347] Generated new cluster ID: 69b1c1f286a742fa85d3ffcb5a24f1ed
I20260928 20:18:59.459386 13848 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:18:59.469887 13837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:18:59.462640 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:46999 (local address 127.0.0.1:43137)
0928 20:18:59.462679 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:18:59.462680 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:18:59.462820 (+ 140us) server_negotiation.cc:407] Connection header received
0928 20:18:59.462882 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:18:59.462883 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:18:59.462893 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:18:59.462947 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:18:59.463594 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:59.464333 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:59.465368 (+ 1035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:18:59.465696 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:18:59.465754 (+ 58us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:18:59.467136 (+ 1382us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:18:59.467138 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:18:59.467138 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:18:59.467145 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:18:59.468713 (+ 1568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:59.469123 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:59.469124 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:59.469124 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:59.469178 (+ 54us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:18:59.469389 (+ 211us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:18:59.469390 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:18:59.469390 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:18:59.469502 (+ 112us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:18:59.469596 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:18:59.469735 (+ 139us) server_negotiation.cc:299] Negotiation successful
0928 20:18:59.469797 (+ 62us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":21}
I20260928 20:18:59.471995 13848 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:18:59.472585 13848 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:18:59.478816 13848 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e92749d13e94c879e945dc429517271: Generated new TSK 0
I20260928 20:18:59.479000 13848 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:18:59.483553 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13766
W20260928 20:18:59.487375 13751 connection.cc:535] client connection to 127.0.0.1:43137 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:43137): Connection reset by peer (error 104)
2026-09-28T20:18:59Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (1358 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:18:59 dist-test-slave-n45k krb5kdc[13865](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:18:59 dist-test-slave-n45k krb5kdc[13865](info): set up 2 sockets
Sep 28 20:18:59 dist-test-slave-n45k krb5kdc[13865](info): commencing operation
krb5kdc: starting...
W20260928 20:19:00.538765 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.038s user 0.004s sys 0.001s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:00 dist-test-slave-n45k krb5kdc[13865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626740, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:19:00.661443 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45797
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:35203
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45797
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:00.741741 13878 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:00.741954 13878 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:00.741977 13878 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:00.743194 13878 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:00.743242 13878 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:00.743255 13878 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:00.743268 13878 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:00.743281 13878 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:00.744801 13878 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:35203
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45797
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45797
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13878
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:00.745055 13878 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:00.745285 13878 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:00.750571 13884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:00.750566 13883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:00.750578 13886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:00.750619 13878 server_base.cc:1034] running on GCE node
I20260928 20:19:00.751022 13878 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:00.751554 13878 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:00.752846 13878 hybrid_clock.cc:648] HybridClock initialized: now 1790626740752817 us; error 33 us; skew 500 ppm
Sep 28 20:19:00 dist-test-slave-n45k krb5kdc[13865](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626740, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:00.755875 13878 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:19:00.756387 13878 webserver.cc:460] Webserver started at http://127.0.0.1:45225/ using document root <none> and password file <none>
I20260928 20:19:00.756613 13878 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:00.756676 13878 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:00.756824 13878 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:00.757915 13878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "f35ddaa1b9b74a46bba1f66851b1355c"
format_stamp: "Formatted at 2026-09-28 20:19:00 on dist-test-slave-n45k"
server_key: "2b752139cb41697aa6c04f05f6572256"
server_key_iv: "a1dbd862974b25c6d7db6282b851ff9b"
server_key_version: "encryptionkey@0"
I20260928 20:19:00.758394 13878 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "f35ddaa1b9b74a46bba1f66851b1355c"
format_stamp: "Formatted at 2026-09-28 20:19:00 on dist-test-slave-n45k"
server_key: "2b752139cb41697aa6c04f05f6572256"
server_key_iv: "a1dbd862974b25c6d7db6282b851ff9b"
server_key_version: "encryptionkey@0"
I20260928 20:19:00.759783 13878 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:19:00.760531 13893 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:00.760743 13878 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:19:00.760848 13878 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "f35ddaa1b9b74a46bba1f66851b1355c"
format_stamp: "Formatted at 2026-09-28 20:19:00 on dist-test-slave-n45k"
server_key: "2b752139cb41697aa6c04f05f6572256"
server_key_iv: "a1dbd862974b25c6d7db6282b851ff9b"
server_key_version: "encryptionkey@0"
I20260928 20:19:00.760931 13878 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:00.773689 13878 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:00.775955 13878 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:00.776144 13878 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:00.780704 13878 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45797
I20260928 20:19:00.780735 13945 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45797 every 8 connection(s)
I20260928 20:19:00.781108 13878 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:00.782001 13946 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:00.784379 13946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c: Bootstrap starting.
I20260928 20:19:00.784911 13946 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:00.785162 13946 log.cc:824] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:00.785861 13946 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c: No bootstrap required, opened a new log
I20260928 20:19:00.786487 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13878
I20260928 20:19:00.786659 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:00.786849 25336 external_mini_cluster.cc:1428] Setting key 015f0b13e16b43508cea652fdc7d087c
I20260928 20:19:00.788003 13946 raft_consensus.cc:348] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45797 } }
I20260928 20:19:00.788169 13946 raft_consensus.cc:374] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:00.788218 13946 raft_consensus.cc:729] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35ddaa1b9b74a46bba1f66851b1355c, State: Initialized, Role: FOLLOWER
I20260928 20:19:00.788406 13946 consensus_queue.cc:260] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45797 } }
I20260928 20:19:00.788507 13946 raft_consensus.cc:388] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:00.788570 13946 raft_consensus.cc:482] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:00.788622 13946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:00.789172 13946 raft_consensus.cc:504] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45797 } }
I20260928 20:19:00.789259 13946 leader_election.cc:302] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f35ddaa1b9b74a46bba1f66851b1355c; no voters:
I20260928 20:19:00.789431 13946 leader_election.cc:288] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:00.789458 13951 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:00.789570 13951 raft_consensus.cc:686] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [term 1 LEADER]: Becoming Leader. State: Replica: f35ddaa1b9b74a46bba1f66851b1355c, State: Running, Role: LEADER
I20260928 20:19:00.789692 13946 sys_catalog.cc:564] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:00.789707 13951 consensus_queue.cc:237] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45797 } }
I20260928 20:19:00.790102 13951 sys_catalog.cc:455] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [sys.catalog]: SysCatalogTable state changed. Reason: New leader f35ddaa1b9b74a46bba1f66851b1355c. Latest consensus state: current_term: 1 leader_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45797 } } }
I20260928 20:19:00.790198 13952 sys_catalog.cc:455] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f35ddaa1b9b74a46bba1f66851b1355c" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45797 } } }
I20260928 20:19:00.790252 13951 sys_catalog.cc:458] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:00.790316 13952 sys_catalog.cc:458] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:00.791134 13960 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:00.791719 13960 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:00.793422 13960 catalog_manager.cc:1347] Generated new cluster ID: c9bf16bfb2794b0ba7f0140523772091
I20260928 20:19:00.793471 13960 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:00.793809 13950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:00.787459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:58369 (local address 127.0.0.1:45797)
0928 20:19:00.787634 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:00.787642 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:00.787669 (+ 27us) server_negotiation.cc:407] Connection header received
0928 20:19:00.787984 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:00.787989 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:00.788040 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:00.788288 (+ 248us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:00.788493 (+ 205us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:00.790088 (+ 1595us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:00.791344 (+ 1256us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:00.792003 (+ 659us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:00.792142 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:00.792939 (+ 797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:00.792943 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:00.792943 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:00.793163 (+ 220us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:00.793201 (+ 38us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:00.793216 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:00.793310 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:00.793614 (+ 304us) server_negotiation.cc:299] Negotiation successful
0928 20:19:00.793638 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":75,"threads_started":1}
I20260928 20:19:00.794802 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:00.799314 13950 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:00.796203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:41095 (local address 127.0.0.1:45797)
0928 20:19:00.796241 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:00.796243 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:00.796356 (+ 113us) server_negotiation.cc:407] Connection header received
0928 20:19:00.796426 (+ 70us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:00.796427 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:00.796439 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:00.796494 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:00.796622 (+ 128us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:00.797138 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:00.797938 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:00.798196 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:00.798314 (+ 118us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:00.799027 (+ 713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:00.799029 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:00.799029 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:00.799034 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:00.799049 (+ 15us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:00.799053 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:00.799129 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:00.799197 (+ 68us) server_negotiation.cc:299] Negotiation successful
0928 20:19:00.799210 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:19:00.806849 13960 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:00.807502 13960 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:00.817292 13960 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f35ddaa1b9b74a46bba1f66851b1355c: Generated new TSK 0
I20260928 20:19:00.817507 13960 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:00.819578 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13878
W20260928 20:19:00.823819 13863 connection.cc:535] client connection to 127.0.0.1:45797 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:45797): Connection reset by peer (error 104)
2026-09-28T20:19:00Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (1336 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:00 dist-test-slave-n45k krb5kdc[13977](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:00 dist-test-slave-n45k krb5kdc[13977](info): set up 2 sockets
Sep 28 20:19:00 dist-test-slave-n45k krb5kdc[13977](info): commencing operation
krb5kdc: starting...
W20260928 20:19:01.850869 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:01 dist-test-slave-n45k krb5kdc[13977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626741, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:01Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:01Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:19:01.981194 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41517
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36733
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:41517
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:02.064728 13990 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:02.064946 13990 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:02.064970 13990 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:02.066130 13990 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:02.066177 13990 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:02.066197 13990 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:02.066210 13990 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:02.066223 13990 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:02.067755 13990 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36733
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:41517
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:41517
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.13990
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:02.068006 13990 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:02.068243 13990 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:02.073369 13995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:02.073455 13996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:02.073369 13998 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:02.073544 13990 server_base.cc:1034] running on GCE node
I20260928 20:19:02.073791 13990 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:02.074074 13990 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:02.075235 13990 hybrid_clock.cc:648] HybridClock initialized: now 1790626742075215 us; error 37 us; skew 500 ppm
Sep 28 20:19:02 dist-test-slave-n45k krb5kdc[13977](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626742, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:02.078047 13990 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:19:02.078559 13990 webserver.cc:460] Webserver started at http://127.0.0.1:33275/ using document root <none> and password file <none>
I20260928 20:19:02.078787 13990 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:02.078853 13990 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:02.078999 13990 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:02.080204 13990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "49b64f28ff644b73bed318d77a567b6b"
format_stamp: "Formatted at 2026-09-28 20:19:02 on dist-test-slave-n45k"
server_key: "c565d7dc8345f9edd4ad8d4c9dadcf8b"
server_key_iv: "a2e640454b2defa020ab7c28c5d22e9f"
server_key_version: "encryptionkey@0"
I20260928 20:19:02.080567 13990 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "49b64f28ff644b73bed318d77a567b6b"
format_stamp: "Formatted at 2026-09-28 20:19:02 on dist-test-slave-n45k"
server_key: "c565d7dc8345f9edd4ad8d4c9dadcf8b"
server_key_iv: "a2e640454b2defa020ab7c28c5d22e9f"
server_key_version: "encryptionkey@0"
I20260928 20:19:02.081939 13990 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:19:02.082876 14005 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:02.083042 13990 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:02.083139 13990 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "49b64f28ff644b73bed318d77a567b6b"
format_stamp: "Formatted at 2026-09-28 20:19:02 on dist-test-slave-n45k"
server_key: "c565d7dc8345f9edd4ad8d4c9dadcf8b"
server_key_iv: "a2e640454b2defa020ab7c28c5d22e9f"
server_key_version: "encryptionkey@0"
I20260928 20:19:02.083282 13990 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:02.086831 13990 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:02.088788 13990 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:02.088935 13990 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:02.092809 13990 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:41517
I20260928 20:19:02.092842 14057 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:41517 every 8 connection(s)
I20260928 20:19:02.093173 13990 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:02.094224 14058 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:02.096228 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 13990
I20260928 20:19:02.096360 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:02.096539 25336 external_mini_cluster.cc:1428] Setting key ef4ffdf6a96fd3c7fe87a766b787e5a1
I20260928 20:19:02.096581 14058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b: Bootstrap starting.
I20260928 20:19:02.097281 14058 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:02.097580 14058 log.cc:824] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:02.098253 14058 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b: No bootstrap required, opened a new log
I20260928 20:19:02.099361 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:02.097063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:47951 (local address 127.0.0.1:41517)
0928 20:19:02.097317 (+ 254us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:02.097325 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:02.097353 (+ 28us) server_negotiation.cc:407] Connection header received
0928 20:19:02.097974 (+ 621us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:02.097981 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:02.098008 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:02.098175 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:02.098896 (+ 721us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:02.098900 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:02.098900 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:02.098905 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:02.098949 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:02.098963 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:02.099055 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:02.099126 (+ 71us) server_negotiation.cc:299] Negotiation successful
0928 20:19:02.099170 (+ 44us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":194,"thread_start_us":78,"threads_started":1}
I20260928 20:19:02.100358 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:02.100832 14058 raft_consensus.cc:348] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b64f28ff644b73bed318d77a567b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41517 } }
I20260928 20:19:02.100962 14058 raft_consensus.cc:374] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:02.100983 14058 raft_consensus.cc:729] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b64f28ff644b73bed318d77a567b6b, State: Initialized, Role: FOLLOWER
I20260928 20:19:02.101119 14058 consensus_queue.cc:260] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b64f28ff644b73bed318d77a567b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41517 } }
I20260928 20:19:02.101197 14058 raft_consensus.cc:388] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:02.101243 14058 raft_consensus.cc:482] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:02.101289 14058 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:02.101887 14058 raft_consensus.cc:504] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b64f28ff644b73bed318d77a567b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41517 } }
I20260928 20:19:02.102010 14058 leader_election.cc:302] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49b64f28ff644b73bed318d77a567b6b; no voters:
I20260928 20:19:02.102185 14058 leader_election.cc:288] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:02.102209 14068 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:02.102383 14068 raft_consensus.cc:686] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [term 1 LEADER]: Becoming Leader. State: Replica: 49b64f28ff644b73bed318d77a567b6b, State: Running, Role: LEADER
I20260928 20:19:02.102483 14068 consensus_queue.cc:237] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b64f28ff644b73bed318d77a567b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41517 } }
I20260928 20:19:02.102463 14058 sys_catalog.cc:564] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:02.102851 14069 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49b64f28ff644b73bed318d77a567b6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b64f28ff644b73bed318d77a567b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41517 } } }
I20260928 20:19:02.102943 14069 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:02.103107 14070 sys_catalog.cc:455] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49b64f28ff644b73bed318d77a567b6b. Latest consensus state: current_term: 1 leader_uuid: "49b64f28ff644b73bed318d77a567b6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b64f28ff644b73bed318d77a567b6b" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 41517 } } }
I20260928 20:19:02.103178 14061 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:02.101757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:45241 (local address 127.0.0.1:41517)
0928 20:19:02.101796 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:02.101798 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:02.101930 (+ 132us) server_negotiation.cc:407] Connection header received
0928 20:19:02.101975 (+ 45us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:02.101976 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:02.101981 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:02.102031 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:02.102886 (+ 855us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:02.102887 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:02.102887 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:02.102891 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:02.102905 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:02.102909 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:02.102973 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:02.103062 (+ 89us) server_negotiation.cc:299] Negotiation successful
0928 20:19:02.103077 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:19:02.103183 14070 sys_catalog.cc:458] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:02.104179 14072 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:02.104789 14072 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:02.106144 14072 catalog_manager.cc:1347] Generated new cluster ID: 0976a8f80c834814bfeac4bfed813cb9
I20260928 20:19:02.106195 14072 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:02.116271 14072 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:02.116443 14072 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:02.123584 14072 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 49b64f28ff644b73bed318d77a567b6b: Generated new TSK 0
I20260928 20:19:02.123760 14072 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:02.129930 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 13990
2026-09-28T20:19:02Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (1310 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:02 dist-test-slave-n45k krb5kdc[14089](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:02 dist-test-slave-n45k krb5kdc[14089](info): set up 2 sockets
Sep 28 20:19:02 dist-test-slave-n45k krb5kdc[14089](info): commencing operation
krb5kdc: starting...
W20260928 20:19:03.170986 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:03 dist-test-slave-n45k krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:03Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:03Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:19:03.293385 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44017
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42181
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44017
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:03.375514 14102 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:03.375754 14102 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:03.375792 14102 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:03.376969 14102 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:03.377041 14102 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:03.377074 14102 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:03.377101 14102 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:03.377128 14102 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:03.378651 14102 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42181
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44017
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44017
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:03.378935 14102 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:03.379174 14102 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:03.384105 14107 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:03.384186 14108 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:03.384085 14110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:03.384506 14102 server_base.cc:1034] running on GCE node
I20260928 20:19:03.384748 14102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:03.385033 14102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:03.386199 14102 hybrid_clock.cc:648] HybridClock initialized: now 1790626743386180 us; error 28 us; skew 500 ppm
Sep 28 20:19:03 dist-test-slave-n45k krb5kdc[14089](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626743, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:03.388888 14102 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:19:03.389276 14102 webserver.cc:460] Webserver started at http://127.0.0.1:36233/ using document root <none> and password file <none>
I20260928 20:19:03.389459 14102 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:03.389499 14102 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:03.389587 14102 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:03.390733 14102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "73a50a0f06ed4080bd25efc236f7b342"
format_stamp: "Formatted at 2026-09-28 20:19:03 on dist-test-slave-n45k"
server_key: "8dec587daf2fff58847bbb02ee5ca763"
server_key_iv: "a7590eeb0d7d56a9f9f36c7c5d45abe1"
server_key_version: "encryptionkey@0"
I20260928 20:19:03.391028 14102 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "73a50a0f06ed4080bd25efc236f7b342"
format_stamp: "Formatted at 2026-09-28 20:19:03 on dist-test-slave-n45k"
server_key: "8dec587daf2fff58847bbb02ee5ca763"
server_key_iv: "a7590eeb0d7d56a9f9f36c7c5d45abe1"
server_key_version: "encryptionkey@0"
I20260928 20:19:03.392448 14102 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:19:03.393201 14117 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:03.393368 14102 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:19:03.393472 14102 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "73a50a0f06ed4080bd25efc236f7b342"
format_stamp: "Formatted at 2026-09-28 20:19:03 on dist-test-slave-n45k"
server_key: "8dec587daf2fff58847bbb02ee5ca763"
server_key_iv: "a7590eeb0d7d56a9f9f36c7c5d45abe1"
server_key_version: "encryptionkey@0"
I20260928 20:19:03.393545 14102 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:03.416574 14102 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:03.419196 14102 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:03.419368 14102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:03.423290 14102 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44017
I20260928 20:19:03.423328 14169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44017 every 8 connection(s)
I20260928 20:19:03.423674 14102 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:03.424503 14170 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:03.426944 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342: Bootstrap starting.
I20260928 20:19:03.427527 14170 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:03.427809 14170 log.cc:824] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:03.428460 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14102
I20260928 20:19:03.428586 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:03.428640 14170 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342: No bootstrap required, opened a new log
I20260928 20:19:03.428788 25336 external_mini_cluster.cc:1428] Setting key a7c672578505d572ae519128c4768d49
I20260928 20:19:03.430572 14170 raft_consensus.cc:348] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a50a0f06ed4080bd25efc236f7b342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44017 } }
I20260928 20:19:03.430737 14170 raft_consensus.cc:374] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:03.430783 14170 raft_consensus.cc:729] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73a50a0f06ed4080bd25efc236f7b342, State: Initialized, Role: FOLLOWER
I20260928 20:19:03.430925 14170 consensus_queue.cc:260] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a50a0f06ed4080bd25efc236f7b342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44017 } }
I20260928 20:19:03.431013 14170 raft_consensus.cc:388] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:03.431056 14170 raft_consensus.cc:482] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:03.431106 14170 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:03.431957 14170 raft_consensus.cc:504] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a50a0f06ed4080bd25efc236f7b342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44017 } }
I20260928 20:19:03.432076 14170 leader_election.cc:302] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 73a50a0f06ed4080bd25efc236f7b342; no voters:
I20260928 20:19:03.432256 14170 leader_election.cc:288] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:03.432281 14175 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:03.432391 14175 raft_consensus.cc:686] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [term 1 LEADER]: Becoming Leader. State: Replica: 73a50a0f06ed4080bd25efc236f7b342, State: Running, Role: LEADER
I20260928 20:19:03.432487 14175 consensus_queue.cc:237] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a50a0f06ed4080bd25efc236f7b342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44017 } }
I20260928 20:19:03.432562 14170 sys_catalog.cc:564] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:03.432818 14175 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 73a50a0f06ed4080bd25efc236f7b342. Latest consensus state: current_term: 1 leader_uuid: "73a50a0f06ed4080bd25efc236f7b342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a50a0f06ed4080bd25efc236f7b342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44017 } } }
I20260928 20:19:03.432833 14176 sys_catalog.cc:455] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "73a50a0f06ed4080bd25efc236f7b342" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "73a50a0f06ed4080bd25efc236f7b342" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44017 } } }
I20260928 20:19:03.432937 14175 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:03.432952 14176 sys_catalog.cc:458] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:03.433184 14180 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:03.433704 14180 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:03.435366 14180 catalog_manager.cc:1347] Generated new cluster ID: 9856c27c4ab1408a938972c0414adbcd
I20260928 20:19:03.435431 14180 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:19:03 dist-test-slave-n45k krb5kdc[14089](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626743, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260928 20:19:03.441995 14180 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:03.442046 14174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:03.429366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:37051 (local address 127.0.0.1:44017)
0928 20:19:03.429530 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:03.429539 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:03.429569 (+ 30us) server_negotiation.cc:407] Connection header received
0928 20:19:03.430559 (+ 990us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:03.430567 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:03.430665 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:03.430818 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:03.431629 (+ 811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:03.432758 (+ 1129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:03.434021 (+ 1263us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:03.434577 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:03.434724 (+ 147us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:03.437469 (+ 2745us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:03.437473 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:03.437473 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:03.437527 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:03.439939 (+ 2412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:03.440427 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:03.440430 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:03.440430 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:03.440553 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:03.440793 (+ 240us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:03.440794 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:03.440794 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:03.441085 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:03.441246 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:03.441691 (+ 445us) server_negotiation.cc:299] Negotiation successful
0928 20:19:03.441803 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":111,"thread_start_us":84,"threads_started":1}
I20260928 20:19:03.442691 14180 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:03.443064 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:03.446677 14180 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 73a50a0f06ed4080bd25efc236f7b342: Generated new TSK 0
I20260928 20:19:03.446859 14180 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:03.451923 14174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:03.444481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:34057 (local address 127.0.0.1:44017)
0928 20:19:03.444512 (+ 31us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:03.444513 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:03.444641 (+ 128us) server_negotiation.cc:407] Connection header received
0928 20:19:03.444704 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:03.444704 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:03.444714 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:03.444772 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:03.445403 (+ 631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:03.446188 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:03.447302 (+ 1114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:03.447518 (+ 216us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:03.447574 (+ 56us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:03.448959 (+ 1385us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:03.448960 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:03.448961 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:03.448966 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:03.450569 (+ 1603us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:03.451005 (+ 436us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:03.451006 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:03.451006 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:03.451067 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:03.451424 (+ 357us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:03.451425 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:03.451425 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:03.451540 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:03.451637 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:03.451778 (+ 141us) server_negotiation.cc:299] Negotiation successful
0928 20:19:03.451831 (+ 53us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14}
I20260928 20:19:03.454062 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14102
W20260928 20:19:03.458246 14087 connection.cc:535] client connection to 127.0.0.1:44017 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44017): Connection reset by peer (error 104)
2026-09-28T20:19:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (1324 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:03 dist-test-slave-n45k krb5kdc[14201](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:03 dist-test-slave-n45k krb5kdc[14201](info): set up 2 sockets
Sep 28 20:19:03 dist-test-slave-n45k krb5kdc[14201](info): commencing operation
krb5kdc: starting...
W20260928 20:19:04.514753 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.043s user 0.001s sys 0.004s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:04 dist-test-slave-n45k krb5kdc[14201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626744, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:04Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:04Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:19:04.633883 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37251
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39337
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37251
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:04.716661 14214 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:04.716900 14214 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:04.716939 14214 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:04.718138 14214 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:04.718206 14214 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:04.718230 14214 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:04.718253 14214 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:04.718308 14214 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:04.719818 14214 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39337
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37251
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37251
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14214
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:04.720114 14214 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:04.720337 14214 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:04.725097 14222 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:04.725107 14220 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:04.725108 14219 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:04.725394 14214 server_base.cc:1034] running on GCE node
I20260928 20:19:04.725631 14214 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:04.725908 14214 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:04.727067 14214 hybrid_clock.cc:648] HybridClock initialized: now 1790626744727057 us; error 36 us; skew 500 ppm
Sep 28 20:19:04 dist-test-slave-n45k krb5kdc[14201](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626744, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:04.729732 14214 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:19:04.730420 14214 webserver.cc:460] Webserver started at http://127.0.0.1:34029/ using document root <none> and password file <none>
I20260928 20:19:04.730619 14214 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:04.730661 14214 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:04.730752 14214 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:04.731734 14214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "08220046cb38410eb31f5b2b831e7d6f"
format_stamp: "Formatted at 2026-09-28 20:19:04 on dist-test-slave-n45k"
server_key: "c00c4f9997b9b663cc548c3eecfce32d"
server_key_iv: "745eb867b55dbdca3da88f12c71f8fb6"
server_key_version: "encryptionkey@0"
I20260928 20:19:04.732021 14214 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "08220046cb38410eb31f5b2b831e7d6f"
format_stamp: "Formatted at 2026-09-28 20:19:04 on dist-test-slave-n45k"
server_key: "c00c4f9997b9b663cc548c3eecfce32d"
server_key_iv: "745eb867b55dbdca3da88f12c71f8fb6"
server_key_version: "encryptionkey@0"
I20260928 20:19:04.733294 14214 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:19:04.733963 14229 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:04.734112 14214 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:19:04.734200 14214 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "08220046cb38410eb31f5b2b831e7d6f"
format_stamp: "Formatted at 2026-09-28 20:19:04 on dist-test-slave-n45k"
server_key: "c00c4f9997b9b663cc548c3eecfce32d"
server_key_iv: "745eb867b55dbdca3da88f12c71f8fb6"
server_key_version: "encryptionkey@0"
I20260928 20:19:04.734259 14214 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:04.764581 14214 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:04.766872 14214 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:04.766988 14214 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:04.770697 14214 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37251
I20260928 20:19:04.770753 14281 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37251 every 8 connection(s)
I20260928 20:19:04.771144 14214 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:04.772094 14282 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:04.774576 14282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f: Bootstrap starting.
I20260928 20:19:04.775153 14282 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:04.775439 14282 log.cc:824] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:04.776263 14282 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f: No bootstrap required, opened a new log
I20260928 20:19:04.777837 14282 raft_consensus.cc:348] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08220046cb38410eb31f5b2b831e7d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260928 20:19:04.777997 14282 raft_consensus.cc:374] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:04.778043 14282 raft_consensus.cc:729] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08220046cb38410eb31f5b2b831e7d6f, State: Initialized, Role: FOLLOWER
I20260928 20:19:04.778214 14282 consensus_queue.cc:260] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08220046cb38410eb31f5b2b831e7d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260928 20:19:04.778322 14282 raft_consensus.cc:388] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:04.778376 14282 raft_consensus.cc:482] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:04.778434 14282 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:04.778604 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14214
I20260928 20:19:04.778724 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:04.778910 25336 external_mini_cluster.cc:1428] Setting key ea2665b3bd939c49e67ea614c6d6c907
I20260928 20:19:04.779094 14282 raft_consensus.cc:504] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08220046cb38410eb31f5b2b831e7d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260928 20:19:04.779214 14282 leader_election.cc:302] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 08220046cb38410eb31f5b2b831e7d6f; no voters:
I20260928 20:19:04.779392 14282 leader_election.cc:288] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:04.779623 14288 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:04.779711 14282 sys_catalog.cc:564] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:04.779789 14288 raft_consensus.cc:686] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [term 1 LEADER]: Becoming Leader. State: Replica: 08220046cb38410eb31f5b2b831e7d6f, State: Running, Role: LEADER
I20260928 20:19:04.780004 14288 consensus_queue.cc:237] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08220046cb38410eb31f5b2b831e7d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } }
I20260928 20:19:04.780488 14289 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 08220046cb38410eb31f5b2b831e7d6f. Latest consensus state: current_term: 1 leader_uuid: "08220046cb38410eb31f5b2b831e7d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08220046cb38410eb31f5b2b831e7d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } } }
I20260928 20:19:04.780582 14285 sys_catalog.cc:455] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "08220046cb38410eb31f5b2b831e7d6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "08220046cb38410eb31f5b2b831e7d6f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37251 } } }
I20260928 20:19:04.780661 14285 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:04.780861 14296 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:04.780591 14289 sys_catalog.cc:458] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:04.781452 14296 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:04.783077 14296 catalog_manager.cc:1347] Generated new cluster ID: 87bd9087112a4818b0bee1f395345642
I20260928 20:19:04.783130 14296 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:04.785665 14287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:04.779357 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:46481 (local address 127.0.0.1:37251)
0928 20:19:04.780086 (+ 729us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:04.780096 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:04.780352 (+ 256us) server_negotiation.cc:407] Connection header received
0928 20:19:04.780623 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:04.780630 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:04.780691 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:04.780828 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:04.781244 (+ 416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:04.782775 (+ 1531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:04.783742 (+ 967us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:04.784176 (+ 434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:04.784310 (+ 134us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:04.785030 (+ 720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:04.785034 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:04.785034 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:04.785211 (+ 177us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:04.785252 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:04.785263 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:04.785353 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:04.785434 (+ 81us) server_negotiation.cc:299] Negotiation successful
0928 20:19:04.785463 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":550,"thread_start_us":77,"threads_started":1}
I20260928 20:19:04.786619 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:04.793114 14287 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:04.787929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:46765 (local address 127.0.0.1:37251)
0928 20:19:04.787966 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:04.787967 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:04.790471 (+ 2504us) server_negotiation.cc:407] Connection header received
0928 20:19:04.790538 (+ 67us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:04.790539 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:04.790551 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:04.790599 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:04.790712 (+ 113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:04.791189 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:04.791906 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:04.792125 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:04.792195 (+ 70us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:04.792865 (+ 670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:04.792867 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:04.792867 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:04.792871 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:04.792885 (+ 14us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:04.792889 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:04.792942 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:04.793008 (+ 66us) server_negotiation.cc:299] Negotiation successful
0928 20:19:04.793019 (+ 11us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:19:04.794320 14296 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:04.794790 14296 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:04.800545 14296 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 08220046cb38410eb31f5b2b831e7d6f: Generated new TSK 0
I20260928 20:19:04.800725 14296 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:04.804162 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14214
W20260928 20:19:04.808084 14199 connection.cc:535] client connection to 127.0.0.1:37251 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37251): Connection reset by peer (error 104)
2026-09-28T20:19:04Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (1349 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:04 dist-test-slave-n45k krb5kdc[14313](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:04 dist-test-slave-n45k krb5kdc[14313](info): set up 2 sockets
Sep 28 20:19:04 dist-test-slave-n45k krb5kdc[14313](info): commencing operation
krb5kdc: starting...
W20260928 20:19:05.863001 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.041s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:05 dist-test-slave-n45k krb5kdc[14313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626745, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260928 20:19:05.985687 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33299
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:45527
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33299
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:06.069496 14326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:06.069754 14326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:06.069801 14326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:06.070988 14326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:06.071061 14326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:06.071084 14326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:06.071105 14326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:06.071134 14326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:06.072616 14326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:45527
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33299
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33299
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14326
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:06.072908 14326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:06.073149 14326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:06.078152 14334 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:06.078349 14326 server_base.cc:1034] running on GCE node
W20260928 20:19:06.078227 14332 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:06.078224 14331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:06.078704 14326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:06.079039 14326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:06.080196 14326 hybrid_clock.cc:648] HybridClock initialized: now 1790626746080172 us; error 45 us; skew 500 ppm
Sep 28 20:19:06 dist-test-slave-n45k krb5kdc[14313](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626746, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:06.082793 14326 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260928 20:19:06.083258 14326 webserver.cc:460] Webserver started at http://127.0.0.1:40479/ using document root <none> and password file <none>
I20260928 20:19:06.083529 14326 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:06.083599 14326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:06.083746 14326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:06.084803 14326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "f7959637b19048ff8fa732713e4f3904"
format_stamp: "Formatted at 2026-09-28 20:19:06 on dist-test-slave-n45k"
server_key: "232e8d34e74c6402d7112add6cbb6111"
server_key_iv: "627903563114f57f5fc08ae5988b2ef7"
server_key_version: "encryptionkey@0"
I20260928 20:19:06.085176 14326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "f7959637b19048ff8fa732713e4f3904"
format_stamp: "Formatted at 2026-09-28 20:19:06 on dist-test-slave-n45k"
server_key: "232e8d34e74c6402d7112add6cbb6111"
server_key_iv: "627903563114f57f5fc08ae5988b2ef7"
server_key_version: "encryptionkey@0"
I20260928 20:19:06.086604 14326 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:19:06.087352 14341 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:06.087544 14326 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:19:06.087652 14326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "f7959637b19048ff8fa732713e4f3904"
format_stamp: "Formatted at 2026-09-28 20:19:06 on dist-test-slave-n45k"
server_key: "232e8d34e74c6402d7112add6cbb6111"
server_key_iv: "627903563114f57f5fc08ae5988b2ef7"
server_key_version: "encryptionkey@0"
I20260928 20:19:06.087725 14326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:06.091089 14326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:06.092954 14326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:06.093106 14326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:06.096966 14326 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33299
I20260928 20:19:06.096997 14393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33299 every 8 connection(s)
I20260928 20:19:06.097323 14326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:06.098511 14394 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:06.100637 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14326
I20260928 20:19:06.100795 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:06.101020 25336 external_mini_cluster.cc:1428] Setting key 0904a71ecd664e28fd3b00f746914b3b
I20260928 20:19:06.103163 14394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904: Bootstrap starting.
I20260928 20:19:06.103916 14394 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:06.104420 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:06.101951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:33929 (local address 127.0.0.1:33299)
0928 20:19:06.102138 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:06.102147 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:06.102178 (+ 31us) server_negotiation.cc:407] Connection header received
0928 20:19:06.102884 (+ 706us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:06.102894 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:06.102932 (+ 38us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:06.103085 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:06.103811 (+ 726us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:06.103815 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:06.103815 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:06.103820 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:06.103878 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:06.103894 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:06.103993 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:06.104139 (+ 146us) server_negotiation.cc:299] Negotiation successful
0928 20:19:06.104193 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":141,"thread_start_us":68,"threads_started":1}
I20260928 20:19:06.104804 14394 log.cc:824] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:06.105719 14394 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904: No bootstrap required, opened a new log
I20260928 20:19:06.105945 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:06.108502 14394 raft_consensus.cc:348] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7959637b19048ff8fa732713e4f3904" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33299 } }
I20260928 20:19:06.108734 14394 raft_consensus.cc:374] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:06.108780 14394 raft_consensus.cc:729] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7959637b19048ff8fa732713e4f3904, State: Initialized, Role: FOLLOWER
I20260928 20:19:06.108970 14394 consensus_queue.cc:260] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7959637b19048ff8fa732713e4f3904" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33299 } }
I20260928 20:19:06.109156 14394 raft_consensus.cc:388] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:06.109203 14394 raft_consensus.cc:482] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:06.109261 14394 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:06.109628 14397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:06.107887 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.200:52169 (local address 127.0.0.1:33299)
0928 20:19:06.107926 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:06.107928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:06.108059 (+ 131us) server_negotiation.cc:407] Connection header received
0928 20:19:06.108157 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:06.108158 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:06.108163 (+ 5us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:06.108207 (+ 44us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:06.109367 (+ 1160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:06.109368 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:06.109369 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:06.109373 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:06.109389 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:06.109393 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:06.109455 (+ 62us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:06.109558 (+ 103us) server_negotiation.cc:299] Negotiation successful
0928 20:19:06.109571 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:19:06.110112 14394 raft_consensus.cc:504] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7959637b19048ff8fa732713e4f3904" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33299 } }
I20260928 20:19:06.110219 14394 leader_election.cc:302] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f7959637b19048ff8fa732713e4f3904; no voters:
I20260928 20:19:06.110433 14394 leader_election.cc:288] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:06.110487 14404 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:06.110637 14404 raft_consensus.cc:686] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [term 1 LEADER]: Becoming Leader. State: Replica: f7959637b19048ff8fa732713e4f3904, State: Running, Role: LEADER
I20260928 20:19:06.110690 14394 sys_catalog.cc:564] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:06.110719 14404 consensus_queue.cc:237] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7959637b19048ff8fa732713e4f3904" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33299 } }
I20260928 20:19:06.111429 14406 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f7959637b19048ff8fa732713e4f3904. Latest consensus state: current_term: 1 leader_uuid: "f7959637b19048ff8fa732713e4f3904" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7959637b19048ff8fa732713e4f3904" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33299 } } }
I20260928 20:19:06.111516 14406 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:06.111701 14413 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:06.111720 14405 sys_catalog.cc:455] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f7959637b19048ff8fa732713e4f3904" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f7959637b19048ff8fa732713e4f3904" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33299 } } }
I20260928 20:19:06.111850 14405 sys_catalog.cc:458] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:06.112188 14413 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:06.114985 14413 catalog_manager.cc:1347] Generated new cluster ID: fe7853b62f284b41985d0c2b1a3948dd
I20260928 20:19:06.115046 14413 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:06.133947 14413 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:06.134132 14413 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:06.148172 14413 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f7959637b19048ff8fa732713e4f3904: Generated new TSK 0
I20260928 20:19:06.148396 14413 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:06.155794 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14326
2026-09-28T20:19:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (1352 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:06 dist-test-slave-n45k krb5kdc[14425](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:06 dist-test-slave-n45k krb5kdc[14425](info): set up 2 sockets
Sep 28 20:19:06 dist-test-slave-n45k krb5kdc[14425](info): commencing operation
krb5kdc: starting...
W20260928 20:19:07.271323 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.097s user 0.000s sys 0.006s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:07 dist-test-slave-n45k krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:07.393509 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:36435
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:35325
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:36435
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:07.474951 14438 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:07.475189 14438 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:07.475214 14438 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:07.476446 14438 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:07.476498 14438 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:07.476513 14438 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:07.476526 14438 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:07.476538 14438 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:07.478132 14438 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:35325
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:36435
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:36435
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14438
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:07.478425 14438 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:07.478667 14438 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:07.483721 14446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:07.483752 14444 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:07.483762 14438 server_base.cc:1034] running on GCE node
W20260928 20:19:07.483722 14443 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:07.484278 14438 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:07.484582 14438 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:07.485757 14438 hybrid_clock.cc:648] HybridClock initialized: now 1790626747485742 us; error 44 us; skew 500 ppm
Sep 28 20:19:07 dist-test-slave-n45k krb5kdc[14425](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626747, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:07.493820 14438 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:07.494451 14438 webserver.cc:460] Webserver started at http://127.24.190.62:36115/ using document root <none> and password file <none>
I20260928 20:19:07.494686 14438 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:07.494755 14438 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:07.494920 14438 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:07.496027 14438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "0268eb15058b47548452effba9a5d56c"
format_stamp: "Formatted at 2026-09-28 20:19:07 on dist-test-slave-n45k"
server_key: "cbef66289b7677fbd4a397a6ef4d0bd7"
server_key_iv: "a17f3e8c1f77047dad7462137ca652d7"
server_key_version: "encryptionkey@0"
I20260928 20:19:07.496412 14438 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "0268eb15058b47548452effba9a5d56c"
format_stamp: "Formatted at 2026-09-28 20:19:07 on dist-test-slave-n45k"
server_key: "cbef66289b7677fbd4a397a6ef4d0bd7"
server_key_iv: "a17f3e8c1f77047dad7462137ca652d7"
server_key_version: "encryptionkey@0"
I20260928 20:19:07.497814 14438 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:19:07.498834 14453 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:07.499040 14438 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s
I20260928 20:19:07.499243 14438 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "0268eb15058b47548452effba9a5d56c"
format_stamp: "Formatted at 2026-09-28 20:19:07 on dist-test-slave-n45k"
server_key: "cbef66289b7677fbd4a397a6ef4d0bd7"
server_key_iv: "a17f3e8c1f77047dad7462137ca652d7"
server_key_version: "encryptionkey@0"
I20260928 20:19:07.499336 14438 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:07.508847 14438 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:07.511190 14438 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:07.511351 14438 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:07.515323 14438 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:36435
I20260928 20:19:07.515389 14505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:36435 every 8 connection(s)
I20260928 20:19:07.515731 14438 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:07.516574 14506 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:07.518440 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14438
I20260928 20:19:07.518565 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:07.518785 25336 external_mini_cluster.cc:1428] Setting key e1c54c02b15c5dd1fe89bd8cc56721fd
I20260928 20:19:07.519333 14506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c: Bootstrap starting.
I20260928 20:19:07.520061 14506 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:07.520403 14506 log.cc:824] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:07.521311 14506 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c: No bootstrap required, opened a new log
I20260928 20:19:07.524044 14506 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0268eb15058b47548452effba9a5d56c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36435 } }
I20260928 20:19:07.524241 14506 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:07.524279 14506 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0268eb15058b47548452effba9a5d56c, State: Initialized, Role: FOLLOWER
I20260928 20:19:07.524441 14506 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0268eb15058b47548452effba9a5d56c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36435 } }
I20260928 20:19:07.524536 14506 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:07.524573 14506 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:07.524626 14506 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:07.525243 14506 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0268eb15058b47548452effba9a5d56c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36435 } }
I20260928 20:19:07.525334 14506 leader_election.cc:302] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0268eb15058b47548452effba9a5d56c; no voters:
I20260928 20:19:07.525535 14506 leader_election.cc:288] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:07.525593 14511 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:07.525774 14511 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [term 1 LEADER]: Becoming Leader. State: Replica: 0268eb15058b47548452effba9a5d56c, State: Running, Role: LEADER
I20260928 20:19:07.525874 14506 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:07.525877 14511 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0268eb15058b47548452effba9a5d56c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36435 } }
I20260928 20:19:07.526229 14511 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0268eb15058b47548452effba9a5d56c. Latest consensus state: current_term: 1 leader_uuid: "0268eb15058b47548452effba9a5d56c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0268eb15058b47548452effba9a5d56c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36435 } } }
I20260928 20:19:07.526350 14511 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:07.526240 14513 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0268eb15058b47548452effba9a5d56c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0268eb15058b47548452effba9a5d56c" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36435 } } }
I20260928 20:19:07.526669 14513 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:07.526580 14517 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
Sep 28 20:19:07 dist-test-slave-n45k krb5kdc[14425](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626747, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:19:07.527398 14517 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:07.529234 14517 catalog_manager.cc:1347] Generated new cluster ID: 64286239cf04454eb8454e5becdbb482
I20260928 20:19:07.529285 14517 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:07.531088 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:07.519327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42595 (local address 127.24.190.62:36435)
0928 20:19:07.519528 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:07.519538 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:07.519579 (+ 41us) server_negotiation.cc:407] Connection header received
0928 20:19:07.520234 (+ 655us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:07.520244 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:07.520313 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:07.520476 (+ 163us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:07.521281 (+ 805us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:07.522851 (+ 1570us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:07.523651 (+ 800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:07.524341 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:07.524462 (+ 121us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:07.527589 (+ 3127us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:07.527593 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:07.527594 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:07.527605 (+ 11us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:07.529486 (+ 1881us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:07.529887 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:07.529891 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:07.529891 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:07.529993 (+ 102us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:07.530229 (+ 236us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:07.530229 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:07.530230 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:07.530524 (+ 294us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:07.530679 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:07.530816 (+ 137us) server_negotiation.cc:299] Negotiation successful
0928 20:19:07.530919 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":150,"thread_start_us":75,"threads_started":1}
I20260928 20:19:07.535293 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:07.548744 14509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:07.536732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40543 (local address 127.24.190.62:36435)
0928 20:19:07.536768 (+ 36us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:07.536770 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:07.542514 (+ 5744us) server_negotiation.cc:407] Connection header received
0928 20:19:07.542587 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:07.542588 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:07.542599 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:07.542649 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:07.543200 (+ 551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:07.543701 (+ 501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:07.544505 (+ 804us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:07.544741 (+ 236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:07.544832 (+ 91us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:07.546060 (+ 1228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:07.546062 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:07.546062 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:07.546070 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:07.547564 (+ 1494us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:07.547933 (+ 369us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:07.547934 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:07.547934 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:07.547995 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:07.548215 (+ 220us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:07.548216 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:07.548216 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:07.548329 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:07.548437 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:07.548561 (+ 124us) server_negotiation.cc:299] Negotiation successful
0928 20:19:07.548624 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:19:07.576332 14517 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:07.577135 14517 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:07.583973 14517 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0268eb15058b47548452effba9a5d56c: Generated new TSK 0
I20260928 20:19:07.584180 14517 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:07.589969 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14438
W20260928 20:19:07.594133 14423 connection.cc:535] client connection to 127.24.190.62:36435 recv error: Network error: failed to read from TLS socket (remote: 127.24.190.62:36435): Connection reset by peer (error 104)
2026-09-28T20:19:07Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (1433 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:07 dist-test-slave-n45k krb5kdc[14537](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:07 dist-test-slave-n45k krb5kdc[14537](info): set up 2 sockets
Sep 28 20:19:07 dist-test-slave-n45k krb5kdc[14537](info): commencing operation
krb5kdc: starting...
W20260928 20:19:08.630710 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.023s user 0.001s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:08 dist-test-slave-n45k krb5kdc[14537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626748, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:08Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:08Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:08.753603 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35133
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:46149
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:35133
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:08.834050 14550 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:08.834300 14550 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:08.834326 14550 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:08.835400 14550 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:08.835434 14550 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:08.835448 14550 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:08.835461 14550 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:08.835474 14550 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:08.836843 14550 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:46149
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:35133
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:35133
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14550
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:08.837030 14550 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:08.837190 14550 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:08.842132 14555 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:08.842233 14550 server_base.cc:1034] running on GCE node
W20260928 20:19:08.842298 14556 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:08.842123 14558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:08.842574 14550 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:08.842828 14550 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:08.843973 14550 hybrid_clock.cc:648] HybridClock initialized: now 1790626748843963 us; error 28 us; skew 500 ppm
Sep 28 20:19:08 dist-test-slave-n45k krb5kdc[14537](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626748, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:08.846594 14550 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:08.847013 14550 webserver.cc:460] Webserver started at http://127.24.190.62:38237/ using document root <none> and password file <none>
I20260928 20:19:08.847195 14550 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:08.847234 14550 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:08.847321 14550 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:08.848322 14550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51"
format_stamp: "Formatted at 2026-09-28 20:19:08 on dist-test-slave-n45k"
server_key: "bef475b1fdeae8880ebf1ad32b1546ef"
server_key_iv: "b95a8ff59680d2c90dca7ae673e36b20"
server_key_version: "encryptionkey@0"
I20260928 20:19:08.848627 14550 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51"
format_stamp: "Formatted at 2026-09-28 20:19:08 on dist-test-slave-n45k"
server_key: "bef475b1fdeae8880ebf1ad32b1546ef"
server_key_iv: "b95a8ff59680d2c90dca7ae673e36b20"
server_key_version: "encryptionkey@0"
I20260928 20:19:08.849843 14550 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s
I20260928 20:19:08.850647 14565 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:08.850939 14550 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:19:08.851023 14550 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51"
format_stamp: "Formatted at 2026-09-28 20:19:08 on dist-test-slave-n45k"
server_key: "bef475b1fdeae8880ebf1ad32b1546ef"
server_key_iv: "b95a8ff59680d2c90dca7ae673e36b20"
server_key_version: "encryptionkey@0"
I20260928 20:19:08.851078 14550 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:08.858045 14550 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:08.859979 14550 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:08.860100 14550 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:08.863893 14550 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:35133
I20260928 20:19:08.863952 14617 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:35133 every 8 connection(s)
I20260928 20:19:08.864290 14550 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:08.865197 14618 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:08.867563 14618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51: Bootstrap starting.
I20260928 20:19:08.868221 14618 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:08.868292 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14550
I20260928 20:19:08.868422 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:08.868566 14618 log.cc:824] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:08.868628 25336 external_mini_cluster.cc:1428] Setting key 94de5f9bd7c0c2a2249530f9013f6cc5
I20260928 20:19:08.869360 14618 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51: No bootstrap required, opened a new log
I20260928 20:19:08.871490 14618 raft_consensus.cc:348] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35133 } }
I20260928 20:19:08.871649 14618 raft_consensus.cc:374] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:08.871696 14618 raft_consensus.cc:729] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 495a4d6ee73c4112ae5c27c0ddfa5e51, State: Initialized, Role: FOLLOWER
I20260928 20:19:08.871862 14618 consensus_queue.cc:260] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35133 } }
I20260928 20:19:08.871950 14618 raft_consensus.cc:388] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:08.871989 14618 raft_consensus.cc:482] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:08.872044 14618 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:08.872591 14618 raft_consensus.cc:504] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35133 } }
I20260928 20:19:08.872710 14618 leader_election.cc:302] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 495a4d6ee73c4112ae5c27c0ddfa5e51; no voters:
I20260928 20:19:08.872912 14618 leader_election.cc:288] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:08.872975 14623 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:08.873155 14618 sys_catalog.cc:564] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:08.873730 14623 raft_consensus.cc:686] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [term 1 LEADER]: Becoming Leader. State: Replica: 495a4d6ee73c4112ae5c27c0ddfa5e51, State: Running, Role: LEADER
I20260928 20:19:08.873884 14623 consensus_queue.cc:237] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35133 } }
I20260928 20:19:08.874064 14622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:08.869111 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48297 (local address 127.24.190.62:35133)
0928 20:19:08.869285 (+ 174us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:08.869294 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:08.869331 (+ 37us) server_negotiation.cc:407] Connection header received
0928 20:19:08.869785 (+ 454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:08.869792 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:08.869837 (+ 45us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:08.869984 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:08.870213 (+ 229us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:08.871137 (+ 924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:08.872080 (+ 943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:08.872509 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:08.872639 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:08.873368 (+ 729us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:08.873371 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:08.873372 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:08.873566 (+ 194us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:08.873595 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:08.873606 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:08.873703 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:08.873863 (+ 160us) server_negotiation.cc:299] Negotiation successful
0928 20:19:08.873888 (+ 25us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":128,"thread_start_us":68,"threads_started":1}
I20260928 20:19:08.874656 14625 sys_catalog.cc:455] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35133 } } }
I20260928 20:19:08.875058 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:08.874714 14624 sys_catalog.cc:455] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 495a4d6ee73c4112ae5c27c0ddfa5e51. Latest consensus state: current_term: 1 leader_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "495a4d6ee73c4112ae5c27c0ddfa5e51" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 35133 } } }
I20260928 20:19:08.875092 14625 sys_catalog.cc:458] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:08.875104 14624 sys_catalog.cc:458] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:08.875345 14638 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:08.875881 14638 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:08.877440 14638 catalog_manager.cc:1347] Generated new cluster ID: e82b76c77ed649efb5fbb1f1cd896738
I20260928 20:19:08.877494 14638 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:08.879809 14622 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:08.876589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40263 (local address 127.24.190.62:35133)
0928 20:19:08.876622 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:08.876624 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:08.876772 (+ 148us) server_negotiation.cc:407] Connection header received
0928 20:19:08.876793 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:08.876794 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:08.876803 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:08.876856 (+ 53us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:08.877136 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:08.877743 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:08.878563 (+ 820us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:08.878786 (+ 223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:08.878881 (+ 95us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:08.879570 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:08.879572 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:08.879572 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:08.879577 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:08.879590 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:08.879594 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:08.879647 (+ 53us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:08.879710 (+ 63us) server_negotiation.cc:299] Negotiation successful
0928 20:19:08.879719 (+ 9us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:19:08.906196 14638 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:08.906960 14638 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:08.918180 14638 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 495a4d6ee73c4112ae5c27c0ddfa5e51: Generated new TSK 0
I20260928 20:19:08.918426 14638 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:08.927475 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14550
W20260928 20:19:08.931876 14535 connection.cc:535] client connection to 127.24.190.62:35133 recv error: Network error: failed to read from TLS socket (remote: 127.24.190.62:35133): Connection reset by peer (error 104)
2026-09-28T20:19:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (1337 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:08 dist-test-slave-n45k krb5kdc[14649](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:08 dist-test-slave-n45k krb5kdc[14649](info): set up 2 sockets
Sep 28 20:19:08 dist-test-slave-n45k krb5kdc[14649](info): commencing operation
krb5kdc: starting...
W20260928 20:19:09.966766 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.021s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:10 dist-test-slave-n45k krb5kdc[14649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626750, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:10.085477 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:36567
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44355
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:36567
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:10.169278 14662 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:10.169492 14662 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:10.169515 14662 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:10.170619 14662 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:10.170655 14662 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:10.170670 14662 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:10.170682 14662 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:10.170696 14662 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:10.172361 14662 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44355
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:36567
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:36567
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14662
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:10.172559 14662 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:10.172739 14662 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:10.177700 14667 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:10.177841 14662 server_base.cc:1034] running on GCE node
W20260928 20:19:10.177783 14668 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:10.177788 14670 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:10.178136 14662 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:10.178452 14662 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:10.179630 14662 hybrid_clock.cc:648] HybridClock initialized: now 1790626750179617 us; error 27 us; skew 500 ppm
Sep 28 20:19:10 dist-test-slave-n45k krb5kdc[14649](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626750, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:10.182389 14662 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:10.182870 14662 webserver.cc:460] Webserver started at http://127.24.190.62:37035/ using document root <none> and password file <none>
I20260928 20:19:10.183096 14662 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:10.183161 14662 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:10.183312 14662 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:10.184367 14662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "79c7bde4025e41a8a2897044cd73cf64"
format_stamp: "Formatted at 2026-09-28 20:19:10 on dist-test-slave-n45k"
server_key: "63187a7fc08f6cb1de990f9ee2f9a32e"
server_key_iv: "658efe1f4516e35df0f135d18db9c40a"
server_key_version: "encryptionkey@0"
I20260928 20:19:10.184738 14662 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "79c7bde4025e41a8a2897044cd73cf64"
format_stamp: "Formatted at 2026-09-28 20:19:10 on dist-test-slave-n45k"
server_key: "63187a7fc08f6cb1de990f9ee2f9a32e"
server_key_iv: "658efe1f4516e35df0f135d18db9c40a"
server_key_version: "encryptionkey@0"
I20260928 20:19:10.186055 14662 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:19:10.186931 14677 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:10.187131 14662 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s
I20260928 20:19:10.187261 14662 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "79c7bde4025e41a8a2897044cd73cf64"
format_stamp: "Formatted at 2026-09-28 20:19:10 on dist-test-slave-n45k"
server_key: "63187a7fc08f6cb1de990f9ee2f9a32e"
server_key_iv: "658efe1f4516e35df0f135d18db9c40a"
server_key_version: "encryptionkey@0"
I20260928 20:19:10.187350 14662 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:10.190634 14662 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:10.192653 14662 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:10.192822 14662 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:10.196791 14662 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:36567
I20260928 20:19:10.196821 14729 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:36567 every 8 connection(s)
I20260928 20:19:10.197144 14662 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:10.198069 14730 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:10.199955 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14662
I20260928 20:19:10.200088 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:10.200279 25336 external_mini_cluster.cc:1428] Setting key 49325055eaa5469bf4b325b4c8d38904
I20260928 20:19:10.200680 14730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64: Bootstrap starting.
I20260928 20:19:10.201375 14730 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:10.201697 14730 log.cc:824] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:10.202507 14730 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64: No bootstrap required, opened a new log
I20260928 20:19:10.203293 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:10.200807 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45101 (local address 127.24.190.62:36567)
0928 20:19:10.201013 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:10.201024 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:10.201062 (+ 38us) server_negotiation.cc:407] Connection header received
0928 20:19:10.201704 (+ 642us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:10.201713 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:10.201757 (+ 44us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:10.201912 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:10.202780 (+ 868us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:10.202784 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:10.202784 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:10.202788 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:10.202824 (+ 36us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:10.202834 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:10.202906 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:10.202988 (+ 82us) server_negotiation.cc:299] Negotiation successful
0928 20:19:10.203043 (+ 55us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":144,"thread_start_us":94,"threads_started":1}
I20260928 20:19:10.204277 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:10.204862 14730 raft_consensus.cc:348] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c7bde4025e41a8a2897044cd73cf64" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36567 } }
I20260928 20:19:10.204994 14730 raft_consensus.cc:374] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:10.205016 14730 raft_consensus.cc:729] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79c7bde4025e41a8a2897044cd73cf64, State: Initialized, Role: FOLLOWER
I20260928 20:19:10.205137 14730 consensus_queue.cc:260] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c7bde4025e41a8a2897044cd73cf64" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36567 } }
I20260928 20:19:10.205237 14730 raft_consensus.cc:388] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:10.205291 14730 raft_consensus.cc:482] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:10.205343 14730 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:10.206003 14730 raft_consensus.cc:504] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c7bde4025e41a8a2897044cd73cf64" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36567 } }
I20260928 20:19:10.206120 14730 leader_election.cc:302] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 79c7bde4025e41a8a2897044cd73cf64; no voters:
I20260928 20:19:10.206314 14730 leader_election.cc:288] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:10.206342 14740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:10.206445 14740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [term 1 LEADER]: Becoming Leader. State: Replica: 79c7bde4025e41a8a2897044cd73cf64, State: Running, Role: LEADER
I20260928 20:19:10.206557 14740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c7bde4025e41a8a2897044cd73cf64" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36567 } }
I20260928 20:19:10.206561 14730 sys_catalog.cc:564] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:10.206879 14733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:10.205672 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56299 (local address 127.24.190.62:36567)
0928 20:19:10.205726 (+ 54us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:10.205728 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:10.205854 (+ 126us) server_negotiation.cc:407] Connection header received
0928 20:19:10.205928 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:10.205929 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:10.205933 (+ 4us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:10.205987 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:10.206585 (+ 598us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:10.206587 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:10.206587 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:10.206592 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:10.206605 (+ 13us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:10.206609 (+ 4us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:10.206636 (+ 27us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:10.206785 (+ 149us) server_negotiation.cc:299] Negotiation successful
0928 20:19:10.206800 (+ 15us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260928 20:19:10.207728 14741 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "79c7bde4025e41a8a2897044cd73cf64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c7bde4025e41a8a2897044cd73cf64" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36567 } } }
I20260928 20:19:10.207832 14741 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:10.208093 14754 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:10.208204 14742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 79c7bde4025e41a8a2897044cd73cf64. Latest consensus state: current_term: 1 leader_uuid: "79c7bde4025e41a8a2897044cd73cf64" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "79c7bde4025e41a8a2897044cd73cf64" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 36567 } } }
I20260928 20:19:10.208401 14742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:10.208794 14754 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:10.210342 14754 catalog_manager.cc:1347] Generated new cluster ID: 694c0d2bc74146f0b80926827b0d5343
I20260928 20:19:10.210394 14754 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:10.221735 14754 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:10.221926 14754 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:10.224586 14754 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 79c7bde4025e41a8a2897044cd73cf64: Generated new TSK 0
I20260928 20:19:10.224792 14754 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:10.227035 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14662
2026-09-28T20:19:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (1299 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:10 dist-test-slave-n45k krb5kdc[14761](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:10 dist-test-slave-n45k krb5kdc[14761](info): set up 2 sockets
Sep 28 20:19:10 dist-test-slave-n45k krb5kdc[14761](info): commencing operation
krb5kdc: starting...
W20260928 20:19:11.258770 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.013s user 0.003s sys 0.002s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:11 dist-test-slave-n45k krb5kdc[14761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:11.381382 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:40995
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:44683
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:40995
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:11.461793 14774 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:11.462056 14774 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:11.462095 14774 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:11.463292 14774 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:11.463371 14774 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:11.463397 14774 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:11.463426 14774 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:11.463456 14774 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:11.464941 14774 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:44683
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:40995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:40995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14774
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:11.465229 14774 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:11.465461 14774 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:11.470690 14779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:11.470695 14782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:11.470695 14780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:11.470837 14774 server_base.cc:1034] running on GCE node
I20260928 20:19:11.471252 14774 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:11.471575 14774 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:11.472725 14774 hybrid_clock.cc:648] HybridClock initialized: now 1790626751472704 us; error 45 us; skew 500 ppm
Sep 28 20:19:11 dist-test-slave-n45k krb5kdc[14761](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626751, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:11.475466 14774 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:11.475908 14774 webserver.cc:460] Webserver started at http://127.24.190.62:33885/ using document root <none> and password file <none>
I20260928 20:19:11.476100 14774 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:11.476148 14774 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:11.476238 14774 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:11.477221 14774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "1d080c37350c40f98f4699f57e5b17f0"
format_stamp: "Formatted at 2026-09-28 20:19:11 on dist-test-slave-n45k"
server_key: "a5452c5c50d28e38cb2dfd69f4bf2d73"
server_key_iv: "c6c6b7e57cb89e5be28e29de4af79f0a"
server_key_version: "encryptionkey@0"
I20260928 20:19:11.477509 14774 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "1d080c37350c40f98f4699f57e5b17f0"
format_stamp: "Formatted at 2026-09-28 20:19:11 on dist-test-slave-n45k"
server_key: "a5452c5c50d28e38cb2dfd69f4bf2d73"
server_key_iv: "c6c6b7e57cb89e5be28e29de4af79f0a"
server_key_version: "encryptionkey@0"
I20260928 20:19:11.478796 14774 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:19:11.479513 14789 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:11.479683 14774 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:19:11.479787 14774 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "1d080c37350c40f98f4699f57e5b17f0"
format_stamp: "Formatted at 2026-09-28 20:19:11 on dist-test-slave-n45k"
server_key: "a5452c5c50d28e38cb2dfd69f4bf2d73"
server_key_iv: "c6c6b7e57cb89e5be28e29de4af79f0a"
server_key_version: "encryptionkey@0"
I20260928 20:19:11.479859 14774 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:11.493193 14774 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:11.495505 14774 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:11.495700 14774 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:11.499631 14774 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:40995
I20260928 20:19:11.499668 14841 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:40995 every 8 connection(s)
I20260928 20:19:11.500046 14774 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:11.500931 14842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:11.503201 14842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0: Bootstrap starting.
I20260928 20:19:11.503741 14842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:11.503978 14842 log.cc:824] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:11.504609 14842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0: No bootstrap required, opened a new log
I20260928 20:19:11.506084 14842 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d080c37350c40f98f4699f57e5b17f0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40995 } }
I20260928 20:19:11.506244 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14774
I20260928 20:19:11.506222 14842 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:11.506332 14842 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d080c37350c40f98f4699f57e5b17f0, State: Initialized, Role: FOLLOWER
I20260928 20:19:11.506379 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:11.506516 14842 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d080c37350c40f98f4699f57e5b17f0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40995 } }
I20260928 20:19:11.506598 14842 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:11.506552 25336 external_mini_cluster.cc:1428] Setting key 8f6f06767af8a412e107d743de950759
I20260928 20:19:11.506623 14842 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:11.506695 14842 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:11.507774 14842 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d080c37350c40f98f4699f57e5b17f0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40995 } }
I20260928 20:19:11.507894 14842 leader_election.cc:302] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1d080c37350c40f98f4699f57e5b17f0; no voters:
I20260928 20:19:11.508059 14842 leader_election.cc:288] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:11.508081 14847 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:11.508322 14847 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [term 1 LEADER]: Becoming Leader. State: Replica: 1d080c37350c40f98f4699f57e5b17f0, State: Running, Role: LEADER
I20260928 20:19:11.508322 14842 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:11.508525 14847 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d080c37350c40f98f4699f57e5b17f0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40995 } }
I20260928 20:19:11.510378 14849 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1d080c37350c40f98f4699f57e5b17f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d080c37350c40f98f4699f57e5b17f0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40995 } } }
I20260928 20:19:11.510388 14848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1d080c37350c40f98f4699f57e5b17f0. Latest consensus state: current_term: 1 leader_uuid: "1d080c37350c40f98f4699f57e5b17f0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1d080c37350c40f98f4699f57e5b17f0" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 40995 } } }
I20260928 20:19:11.510479 14849 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:11.510497 14848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0 [sys.catalog]: This master's current role is: LEADER
W20260928 20:19:11.510641 14862 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:11.510690 14862 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:19:11.511021 14864 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:11.511204 14864 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:11.512879 14864 catalog_manager.cc:1347] Generated new cluster ID: c55827f6e8d2498ab4d14bbf0b72cfba
I20260928 20:19:11.512950 14864 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
Sep 28 20:19:11 dist-test-slave-n45k krb5kdc[14761](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626751, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:19:11.518787 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:11.507119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38327 (local address 127.24.190.62:40995)
0928 20:19:11.507332 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:11.507339 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:11.507465 (+ 126us) server_negotiation.cc:407] Connection header received
0928 20:19:11.507569 (+ 104us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:11.507574 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:11.507623 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:11.507753 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:11.508541 (+ 788us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:11.509835 (+ 1294us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:11.510921 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:11.511526 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:11.511722 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:11.514767 (+ 3045us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:11.514772 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:11.514772 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:11.514785 (+ 13us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:11.516894 (+ 2109us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:11.517374 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:11.517376 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:11.517377 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:11.517504 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:11.517734 (+ 230us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:11.517735 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:11.517735 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:11.518066 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:11.518239 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:11.518381 (+ 142us) server_negotiation.cc:299] Negotiation successful
0928 20:19:11.518551 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":87,"threads_started":1}
I20260928 20:19:11.520100 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:11.529250 14846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:11.521742 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57007 (local address 127.24.190.62:40995)
0928 20:19:11.521782 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:11.521784 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:11.521845 (+ 61us) server_negotiation.cc:407] Connection header received
0928 20:19:11.521910 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:11.521911 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:11.521933 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:11.521988 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:11.522652 (+ 664us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:11.523473 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:11.524502 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:11.524833 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:11.524896 (+ 63us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:11.526345 (+ 1449us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:11.526346 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:11.526346 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:11.526353 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:11.527992 (+ 1639us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:11.528393 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:11.528394 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:11.528394 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:11.528451 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:11.528676 (+ 225us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:11.528677 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:11.528677 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:11.528796 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:11.528876 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:11.529073 (+ 197us) server_negotiation.cc:299] Negotiation successful
0928 20:19:11.529153 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:19:11.533602 14864 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:11.534368 14864 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:11.539438 14864 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1d080c37350c40f98f4699f57e5b17f0: Generated new TSK 0
I20260928 20:19:11.539657 14864 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:11.544541 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14774
2026-09-28T20:19:11Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (1317 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:11 dist-test-slave-n45k krb5kdc[14873](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:11 dist-test-slave-n45k krb5kdc[14873](info): set up 2 sockets
Sep 28 20:19:11 dist-test-slave-n45k krb5kdc[14873](info): commencing operation
krb5kdc: starting...
W20260928 20:19:12.599165 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.036s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:12 dist-test-slave-n45k krb5kdc[14873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626752, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:12.720813 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41063
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:43961
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:12.802493 14886 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:12.802736 14886 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:12.802776 14886 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:12.803962 14886 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:12.804035 14886 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:12.804059 14886 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:12.804081 14886 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:12.804111 14886 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:12.805593 14886 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:43961
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41063
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14886
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:12.805868 14886 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:12.806114 14886 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:12.811100 14892 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:12.811100 14894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:12.811131 14886 server_base.cc:1034] running on GCE node
W20260928 20:19:12.811120 14891 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:12.811571 14886 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:12.811884 14886 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:12.813068 14886 hybrid_clock.cc:648] HybridClock initialized: now 1790626752813059 us; error 34 us; skew 500 ppm
Sep 28 20:19:12 dist-test-slave-n45k krb5kdc[14873](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626752, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:12.820768 14886 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:12.821293 14886 webserver.cc:460] Webserver started at http://127.24.190.62:44599/ using document root <none> and password file <none>
I20260928 20:19:12.821539 14886 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:12.821616 14886 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:12.821781 14886 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:12.823091 14886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "d13ef3b6b2af4770b389c98d45216ee2"
format_stamp: "Formatted at 2026-09-28 20:19:12 on dist-test-slave-n45k"
server_key: "241383a46168e0bfe9355ddabf03249a"
server_key_iv: "e83ef5c3fd6a9843fae436fde4b5a8eb"
server_key_version: "encryptionkey@0"
I20260928 20:19:12.823472 14886 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "d13ef3b6b2af4770b389c98d45216ee2"
format_stamp: "Formatted at 2026-09-28 20:19:12 on dist-test-slave-n45k"
server_key: "241383a46168e0bfe9355ddabf03249a"
server_key_iv: "e83ef5c3fd6a9843fae436fde4b5a8eb"
server_key_version: "encryptionkey@0"
I20260928 20:19:12.824928 14886 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:19:12.825765 14901 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:12.826023 14886 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:19:12.826144 14886 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "d13ef3b6b2af4770b389c98d45216ee2"
format_stamp: "Formatted at 2026-09-28 20:19:12 on dist-test-slave-n45k"
server_key: "241383a46168e0bfe9355ddabf03249a"
server_key_iv: "e83ef5c3fd6a9843fae436fde4b5a8eb"
server_key_version: "encryptionkey@0"
I20260928 20:19:12.826226 14886 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:12.854803 14886 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:12.857097 14886 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:12.857340 14886 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:12.861608 14886 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:41063
I20260928 20:19:12.861644 14953 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:41063 every 8 connection(s)
I20260928 20:19:12.862017 14886 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:12.862969 14954 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:12.865289 14954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2: Bootstrap starting.
I20260928 20:19:12.865960 14954 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:12.865993 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14886
I20260928 20:19:12.866094 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:12.866339 25336 external_mini_cluster.cc:1428] Setting key 0e39a98e4b42ca95c31f77f095290eb0
I20260928 20:19:12.866336 14954 log.cc:824] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:12.867357 14954 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2: No bootstrap required, opened a new log
I20260928 20:19:12.869582 14954 raft_consensus.cc:348] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d13ef3b6b2af4770b389c98d45216ee2" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41063 } }
I20260928 20:19:12.869766 14954 raft_consensus.cc:374] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:12.869800 14954 raft_consensus.cc:729] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d13ef3b6b2af4770b389c98d45216ee2, State: Initialized, Role: FOLLOWER
I20260928 20:19:12.869916 14954 consensus_queue.cc:260] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d13ef3b6b2af4770b389c98d45216ee2" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41063 } }
I20260928 20:19:12.869987 14954 raft_consensus.cc:388] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:12.870018 14954 raft_consensus.cc:482] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:12.870055 14954 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:12.870687 14954 raft_consensus.cc:504] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d13ef3b6b2af4770b389c98d45216ee2" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41063 } }
I20260928 20:19:12.870826 14954 leader_election.cc:302] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d13ef3b6b2af4770b389c98d45216ee2; no voters:
I20260928 20:19:12.871014 14954 leader_election.cc:288] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:12.871034 14959 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:12.871238 14959 raft_consensus.cc:686] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [term 1 LEADER]: Becoming Leader. State: Replica: d13ef3b6b2af4770b389c98d45216ee2, State: Running, Role: LEADER
I20260928 20:19:12.871351 14954 sys_catalog.cc:564] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:12.871387 14959 consensus_queue.cc:237] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d13ef3b6b2af4770b389c98d45216ee2" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41063 } }
I20260928 20:19:12.872386 14958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:12.866909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60541 (local address 127.24.190.62:41063)
0928 20:19:12.867098 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:12.867105 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:12.867133 (+ 28us) server_negotiation.cc:407] Connection header received
0928 20:19:12.867665 (+ 532us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:12.867671 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:12.867759 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:12.867876 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:12.868123 (+ 247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:12.869028 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:12.870171 (+ 1143us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:12.870679 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:12.870772 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:12.871638 (+ 866us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:12.871642 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:12.871643 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:12.871867 (+ 224us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:12.871912 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:12.871931 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:12.871999 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:12.872112 (+ 113us) server_negotiation.cc:299] Negotiation successful
0928 20:19:12.872182 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140,"thread_start_us":107,"threads_started":1}
I20260928 20:19:12.872656 14960 sys_catalog.cc:455] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d13ef3b6b2af4770b389c98d45216ee2. Latest consensus state: current_term: 1 leader_uuid: "d13ef3b6b2af4770b389c98d45216ee2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d13ef3b6b2af4770b389c98d45216ee2" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41063 } } }
I20260928 20:19:12.872740 14960 sys_catalog.cc:458] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:12.872841 14961 sys_catalog.cc:455] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d13ef3b6b2af4770b389c98d45216ee2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d13ef3b6b2af4770b389c98d45216ee2" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41063 } } }
I20260928 20:19:12.872939 14961 sys_catalog.cc:458] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:12.873034 14971 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:12.873378 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:12.873870 14971 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:12.875612 14971 catalog_manager.cc:1347] Generated new cluster ID: 7694d62977aa4d5bb363ebfcf838bd7d
I20260928 20:19:12.875698 14971 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:12.879086 14958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:12.874951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58735 (local address 127.24.190.62:41063)
0928 20:19:12.875017 (+ 66us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:12.875019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:12.875186 (+ 167us) server_negotiation.cc:407] Connection header received
0928 20:19:12.875247 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:12.875248 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:12.875260 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:12.875333 (+ 73us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:12.875572 (+ 239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:12.876301 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:12.877347 (+ 1046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:12.877648 (+ 301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:12.877706 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:12.878683 (+ 977us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:12.878685 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:12.878685 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:12.878690 (+ 5us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:12.878706 (+ 16us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:12.878712 (+ 6us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:12.878757 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:12.878982 (+ 225us) server_negotiation.cc:299] Negotiation successful
0928 20:19:12.879001 (+ 19us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:19:12.898473 14971 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:12.899056 14971 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:12.905076 14971 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d13ef3b6b2af4770b389c98d45216ee2: Generated new TSK 0
I20260928 20:19:12.905282 14971 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:12.909487 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14886
2026-09-28T20:19:12Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (1363 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:12 dist-test-slave-n45k krb5kdc[14985](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:12 dist-test-slave-n45k krb5kdc[14985](info): set up 2 sockets
Sep 28 20:19:12 dist-test-slave-n45k krb5kdc[14985](info): commencing operation
krb5kdc: starting...
W20260928 20:19:13.958791 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.032s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:14 dist-test-slave-n45k krb5kdc[14985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626754, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:14.076874 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46035
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:37413
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:46035
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:14.157051 14998 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:14.157263 14998 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:14.157287 14998 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:14.158517 14998 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:14.158558 14998 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:14.158573 14998 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:14.158586 14998 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:14.158643 14998 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:14.160132 14998 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:37413
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:46035
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:46035
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.14998
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:14.160406 14998 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:14.160666 14998 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:14.165580 15004 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:14.165676 14998 server_base.cc:1034] running on GCE node
W20260928 20:19:14.165567 15003 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:14.165567 15006 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:14.166069 14998 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:14.166441 14998 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:14.167611 14998 hybrid_clock.cc:648] HybridClock initialized: now 1790626754167595 us; error 40 us; skew 500 ppm
Sep 28 20:19:14 dist-test-slave-n45k krb5kdc[14985](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626754, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:14.170117 14998 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:14.170625 14998 webserver.cc:460] Webserver started at http://127.24.190.62:33953/ using document root <none> and password file <none>
I20260928 20:19:14.170889 14998 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:14.170962 14998 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:14.171108 14998 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:14.172467 14998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "f42bded4fba64ee3953e2cd68b3ed305"
format_stamp: "Formatted at 2026-09-28 20:19:14 on dist-test-slave-n45k"
server_key: "d17911fb80a97228cd815ebcb4ebcee1"
server_key_iv: "33611e5a42470646ceda80e79b22cadb"
server_key_version: "encryptionkey@0"
I20260928 20:19:14.173041 14998 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "f42bded4fba64ee3953e2cd68b3ed305"
format_stamp: "Formatted at 2026-09-28 20:19:14 on dist-test-slave-n45k"
server_key: "d17911fb80a97228cd815ebcb4ebcee1"
server_key_iv: "33611e5a42470646ceda80e79b22cadb"
server_key_version: "encryptionkey@0"
I20260928 20:19:14.175072 14998 fs_manager.cc:691] Time spent creating directory manager: real 0.002s user 0.002s sys 0.002s
I20260928 20:19:14.176149 15013 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:14.176381 14998 fs_manager.cc:725] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s
I20260928 20:19:14.176483 14998 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "f42bded4fba64ee3953e2cd68b3ed305"
format_stamp: "Formatted at 2026-09-28 20:19:14 on dist-test-slave-n45k"
server_key: "d17911fb80a97228cd815ebcb4ebcee1"
server_key_iv: "33611e5a42470646ceda80e79b22cadb"
server_key_version: "encryptionkey@0"
I20260928 20:19:14.176568 14998 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:14.180718 14998 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:14.183419 14998 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:14.183555 14998 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:14.188594 14998 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:46035
I20260928 20:19:14.188627 15065 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:46035 every 8 connection(s)
I20260928 20:19:14.189042 14998 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:14.190043 15066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:14.191589 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 14998
I20260928 20:19:14.191706 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:14.191907 25336 external_mini_cluster.cc:1428] Setting key fb533bd1aa835802e7ab74969ec1e4cb
I20260928 20:19:14.192675 15066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305: Bootstrap starting.
I20260928 20:19:14.193327 15066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:14.194006 15066 log.cc:824] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:14.194443 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:14.192419 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53265 (local address 127.24.190.62:46035)
0928 20:19:14.192582 (+ 163us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:14.192591 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:14.192625 (+ 34us) server_negotiation.cc:407] Connection header received
0928 20:19:14.193097 (+ 472us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:14.193104 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:14.193130 (+ 26us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:14.193253 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:14.193942 (+ 689us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:14.193945 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:14.193945 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:14.193948 (+ 3us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:14.193980 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:14.193990 (+ 10us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:14.194060 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:14.194146 (+ 86us) server_negotiation.cc:299] Negotiation successful
0928 20:19:14.194192 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":113,"thread_start_us":83,"threads_started":1}
I20260928 20:19:14.194881 15066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305: No bootstrap required, opened a new log
I20260928 20:19:14.195453 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:14.197182 15066 raft_consensus.cc:348] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42bded4fba64ee3953e2cd68b3ed305" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46035 } }
I20260928 20:19:14.197377 15066 raft_consensus.cc:374] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260928 20:19:14.197414 15066 raft_consensus.cc:729] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f42bded4fba64ee3953e2cd68b3ed305, State: Initialized, Role: FOLLOWER
I20260928 20:19:14.197556 15066 consensus_queue.cc:260] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42bded4fba64ee3953e2cd68b3ed305" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46035 } }
I20260928 20:19:14.197664 15066 raft_consensus.cc:388] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260928 20:19:14.197697 15066 raft_consensus.cc:482] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260928 20:19:14.197745 15066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:14.197911 15069 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:14.196793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43035 (local address 127.24.190.62:46035)
0928 20:19:14.196830 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:14.196832 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:14.196925 (+ 93us) server_negotiation.cc:407] Connection header received
0928 20:19:14.196981 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:14.196982 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:14.196985 (+ 3us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:14.197025 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:14.197601 (+ 576us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:14.197603 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:14.197603 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0928 20:19:14.197607 (+ 4us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:14.197618 (+ 11us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0928 20:19:14.197621 (+ 3us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:14.197700 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:14.197829 (+ 129us) server_negotiation.cc:299] Negotiation successful
0928 20:19:14.197842 (+ 13us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:19:14.198596 15066 raft_consensus.cc:504] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42bded4fba64ee3953e2cd68b3ed305" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46035 } }
I20260928 20:19:14.198714 15066 leader_election.cc:302] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f42bded4fba64ee3953e2cd68b3ed305; no voters:
I20260928 20:19:14.198874 15066 leader_election.cc:288] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260928 20:19:14.198921 15076 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:14.199082 15076 raft_consensus.cc:686] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [term 1 LEADER]: Becoming Leader. State: Replica: f42bded4fba64ee3953e2cd68b3ed305, State: Running, Role: LEADER
I20260928 20:19:14.199124 15066 sys_catalog.cc:564] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:14.199163 15076 consensus_queue.cc:237] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42bded4fba64ee3953e2cd68b3ed305" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46035 } }
I20260928 20:19:14.199594 15077 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f42bded4fba64ee3953e2cd68b3ed305" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42bded4fba64ee3953e2cd68b3ed305" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46035 } } }
I20260928 20:19:14.199702 15077 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:14.199896 15078 sys_catalog.cc:455] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f42bded4fba64ee3953e2cd68b3ed305. Latest consensus state: current_term: 1 leader_uuid: "f42bded4fba64ee3953e2cd68b3ed305" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f42bded4fba64ee3953e2cd68b3ed305" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 46035 } } }
I20260928 20:19:14.199963 15078 sys_catalog.cc:458] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:14.200290 15085 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:14.200719 15085 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:14.202250 15085 catalog_manager.cc:1347] Generated new cluster ID: 1fdf263e1b5d49918597ab1279859260
I20260928 20:19:14.202335 15085 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:14.231001 15085 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:14.231197 15085 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:14.239077 15085 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f42bded4fba64ee3953e2cd68b3ed305: Generated new TSK 0
I20260928 20:19:14.239288 15085 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:14.248095 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 14998
2026-09-28T20:19:14Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (1339 ms)
[----------] 18 tests from AuthTokenIssuingTest (24140 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:14 dist-test-slave-n45k krb5kdc[15097](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:14 dist-test-slave-n45k krb5kdc[15097](info): set up 2 sockets
Sep 28 20:19:14 dist-test-slave-n45k krb5kdc[15097](info): commencing operation
krb5kdc: starting...
W20260928 20:19:15.342831 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.077s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:15Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:15Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:15.464655 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37553
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:40193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:37553,127.24.190.61:38751,127.24.190.60:44315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:15.544601 15110 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 20:19:15.544838 15110 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:15.544857 15110 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:15.544878 15110 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:15.546001 15110 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:15.546037 15110 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:15.546051 15110 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:15.546064 15110 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:15.546077 15110 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:15.547504 15110 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:40193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:37553,127.24.190.61:38751,127.24.190.60:44315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:37553
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15110
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:15.547703 15110 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:15.547879 15110 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:15.553121 15115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:15.553117 15116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:15.553135 15118 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:15.553453 15110 server_base.cc:1034] running on GCE node
I20260928 20:19:15.553694 15110 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:15.553988 15110 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:15.555151 15110 hybrid_clock.cc:648] HybridClock initialized: now 1790626755555139 us; error 46 us; skew 500 ppm
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:15.557665 15110 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:15.558046 15110 webserver.cc:460] Webserver started at http://127.24.190.62:35645/ using document root <none> and password file <none>
I20260928 20:19:15.558228 15110 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:15.558308 15110 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:15.558429 15110 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:15.559464 15110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "c585cac7bcce49c2bfd17f412f53ac47"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "85f6005b69371d70167e2ec33661ded3"
server_key_iv: "213a6d2ca4a82952e81e3975f62d97a5"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.559758 15110 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "c585cac7bcce49c2bfd17f412f53ac47"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "85f6005b69371d70167e2ec33661ded3"
server_key_iv: "213a6d2ca4a82952e81e3975f62d97a5"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.561043 15110 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:19:15.561684 15125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:15.561885 15110 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:19:15.561981 15110 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "c585cac7bcce49c2bfd17f412f53ac47"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "85f6005b69371d70167e2ec33661ded3"
server_key_iv: "213a6d2ca4a82952e81e3975f62d97a5"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.562059 15110 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:15.581126 15110 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:15.583163 15110 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:15.583328 15110 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:15.587682 15110 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:37553
I20260928 20:19:15.587734 15177 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:37553 every 8 connection(s)
I20260928 20:19:15.588065 15110 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:15.589016 15178 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:15.589332 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 15110
I20260928 20:19:15.589418 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:15.589629 25336 external_mini_cluster.cc:1428] Setting key afdc2a71431d375a3c5404e91c4bf4f9
I20260928 20:19:15.590862 15178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.190.61@KRBTEST.COM; defaulting to no policy
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.61@KRBTEST.COM" created.
I20260928 20:19:15.601032 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.591651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37553 (local address 127.0.0.1:40392)
0928 20:19:15.591870 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.591909 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.592367 (+ 458us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.592667 (+ 300us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.592669 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.592909 (+ 240us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.593060 (+ 151us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.593063 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.594127 (+ 1064us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.594128 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.595016 (+ 888us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.595019 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.595543 (+ 524us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.595545 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.595606 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.596165 (+ 559us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.596172 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.597701 (+ 1529us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.599419 (+ 1718us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.599425 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.599427 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.599691 (+ 264us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.599957 (+ 266us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.599958 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.599958 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.600079 (+ 121us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.600592 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.600597 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.600655 (+ 58us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.600731 (+ 76us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.600866 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":107,"threads_started":1}
I20260928 20:19:15.601136 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.591714 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40392 (local address 127.24.190.62:37553)
0928 20:19:15.591880 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.591896 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.592018 (+ 122us) server_negotiation.cc:407] Connection header received
0928 20:19:15.592523 (+ 505us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.592526 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.592548 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.592652 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.593166 (+ 514us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.594016 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.595122 (+ 1106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.595428 (+ 306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.595559 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.597783 (+ 2224us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.597790 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.597791 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.597797 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.599347 (+ 1550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.599778 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.599781 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.599782 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.599886 (+ 104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.600161 (+ 275us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.600162 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.600163 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.600510 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.600614 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.600795 (+ 181us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.600952 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":37,"server-negotiator.queue_time_us":121,"thread_start_us":74,"threads_started":1}
I20260928 20:19:15.601872 15178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:15.602226 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.602102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56942)
0928 20:19:15.602153 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.602198 (+ 45us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":33}
W20260928 20:19:15.602382 15129 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
I20260928 20:19:15.602814 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.602715 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56944)
0928 20:19:15.602769 (+ 54us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.602793 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
W20260928 20:19:15.602918 15178 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:38751: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab.
Entry for principal kudu/127.24.190.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab.
I20260928 20:19:15.614802 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:38751
--webserver_interface=127.24.190.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab
--principal=kudu/127.24.190.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:40193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:37553,127.24.190.61:38751,127.24.190.60:44315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:19:15.652158 15178 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } attempt: 1
I20260928 20:19:15.652674 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.652535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56950)
0928 20:19:15.652603 (+ 68us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.652644 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":44}
I20260928 20:19:15.653030 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.652936 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56954)
0928 20:19:15.652982 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.653006 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 20:19:15.653115 15178 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:38751: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
W20260928 20:19:15.696316 15185 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 20:19:15.696534 15185 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:15.696551 15185 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:15.696571 15185 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:15.697729 15185 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:15.697772 15185 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:15.697788 15185 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:15.697799 15185 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:15.697815 15185 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:15.699326 15185 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:40193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:37553,127.24.190.61:38751,127.24.190.60:44315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab
--principal=kudu/127.24.190.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:38751
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.190.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15185
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:15.699580 15185 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:15.699827 15185 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:15.704746 15191 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:15.704826 15193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:15.704989 15190 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:15.705046 15185 server_base.cc:1034] running on GCE node
I20260928 20:19:15.705331 15185 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:15.705570 15185 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:15.706714 15185 hybrid_clock.cc:648] HybridClock initialized: now 1790626755706700 us; error 29 us; skew 500 ppm
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:15.709179 15185 init.cc:377] Logged in from keytab as kudu/127.24.190.61@KRBTEST.COM (short username kudu)
I20260928 20:19:15.709576 15185 webserver.cc:460] Webserver started at http://127.24.190.61:41771/ using document root <none> and password file <none>
I20260928 20:19:15.709754 15185 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:15.709794 15185 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:15.709879 15185 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:15.710958 15185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data/instance:
uuid: "54d4d1e3491f457cab90f9ef7f4c08a1"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "6845b28af84d973a4c9f6c0507da2020"
server_key_iv: "2b7d5b7e198dec5b501d2bc519e0cb11"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.711272 15185 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal/instance:
uuid: "54d4d1e3491f457cab90f9ef7f4c08a1"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "6845b28af84d973a4c9f6c0507da2020"
server_key_iv: "2b7d5b7e198dec5b501d2bc519e0cb11"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.712591 15185 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s
I20260928 20:19:15.713292 15200 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:15.713491 15185 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:19:15.713574 15185 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal
uuid: "54d4d1e3491f457cab90f9ef7f4c08a1"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "6845b28af84d973a4c9f6c0507da2020"
server_key_iv: "2b7d5b7e198dec5b501d2bc519e0cb11"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.713621 15185 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:15.721266 15178 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } attempt: 2
I20260928 20:19:15.721657 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.721536 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56960)
0928 20:19:15.721595 (+ 59us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.721631 (+ 36us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260928 20:19:15.722002 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.721904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56968)
0928 20:19:15.721952 (+ 48us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.721983 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 20:19:15.722095 15178 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:38751: Network error: Client connection negotiation failed: client connection to 127.24.190.61:38751: connect: Connection refused (error 111)
I20260928 20:19:15.729396 15185 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:15.731376 15185 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:15.731535 15185 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:15.735709 15185 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.61:38751
I20260928 20:19:15.735741 15252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.61:38751 every 8 connection(s)
I20260928 20:19:15.736125 15185 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
I20260928 20:19:15.737097 15253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:15.738677 15253 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:15.739549 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 15185
I20260928 20:19:15.739665 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-1/wal/instance
I20260928 20:19:15.739848 25336 external_mini_cluster.cc:1428] Setting key 426f98a0d267bd1066b5462f2df00a0a
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
WARNING: no policy specified for kudu/127.24.190.60@KRBTEST.COM; defaulting to no policy
I20260928 20:19:15.748749 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.739378 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40394 (local address 127.24.190.62:37553)
0928 20:19:15.739469 (+ 91us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.739471 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.739681 (+ 210us) server_negotiation.cc:407] Connection header received
0928 20:19:15.740437 (+ 756us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.740439 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.740451 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.740503 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.741375 (+ 872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.742144 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.743180 (+ 1036us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.743537 (+ 357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.743622 (+ 85us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.745821 (+ 2199us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.745823 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.745823 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.745832 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.747472 (+ 1640us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.747911 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.747913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.747913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.747980 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.748225 (+ 245us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.748226 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.748226 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.748345 (+ 119us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.748396 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.748621 (+ 225us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.748686 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260928 20:19:15.749121 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.739335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37553 (local address 127.0.0.1:40394)
0928 20:19:15.739539 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.739587 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.740325 (+ 738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.740574 (+ 249us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.740578 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.740982 (+ 404us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.741258 (+ 276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.741265 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.742240 (+ 975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.742241 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.743087 (+ 846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.743090 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.743679 (+ 589us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.743680 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.743790 (+ 110us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.744326 (+ 536us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.744334 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.745724 (+ 1390us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.747554 (+ 1830us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.747560 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.747561 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.747838 (+ 277us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.748069 (+ 231us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.748070 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.748070 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.748174 (+ 104us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.748403 (+ 229us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.748407 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.748517 (+ 110us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.748599 (+ 82us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.748713 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":159,"thread_start_us":105,"threads_started":1}
I20260928 20:19:15.749688 15253 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } has no permanent_uuid. Determining permanent_uuid...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.60@KRBTEST.COM" created.
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:19:15.757382 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.749964 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56978)
0928 20:19:15.750143 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.750152 (+ 9us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.750185 (+ 33us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.750360 (+ 175us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.750361 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.750466 (+ 105us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.750512 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.750514 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.751623 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.751624 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.752221 (+ 597us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.752223 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.752682 (+ 459us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.752683 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.752771 (+ 88us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.753124 (+ 353us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.753128 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.754261 (+ 1133us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.756381 (+ 2120us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.756382 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.756382 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.756542 (+ 160us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.756768 (+ 226us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.756769 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.756769 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.756819 (+ 50us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.757145 (+ 326us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.757146 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.757178 (+ 32us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.757228 (+ 50us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.757319 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 20:19:15.757503 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.750040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56978 (local address 127.24.190.61:38751)
0928 20:19:15.750166 (+ 126us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.750170 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.750187 (+ 17us) server_negotiation.cc:407] Connection header received
0928 20:19:15.750235 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.750237 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.750248 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.750359 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.750575 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.751527 (+ 952us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.752302 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.752607 (+ 305us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.752664 (+ 57us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.754386 (+ 1722us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.754394 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.754394 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.754401 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.756280 (+ 1879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.756628 (+ 348us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.756631 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.756632 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.756699 (+ 67us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.756882 (+ 183us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.756883 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.756884 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.757074 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.757168 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.757267 (+ 99us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.757387 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":31,"server-negotiator.queue_time_us":101,"thread_start_us":74,"threads_started":1}
I20260928 20:19:15.758148 15253 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:15.758546 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.758436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49916)
0928 20:19:15.758486 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.758527 (+ 41us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":35}
W20260928 20:19:15.758677 15204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
I20260928 20:19:15.759093 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.759005 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49930)
0928 20:19:15.759048 (+ 43us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.759076 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260928 20:19:15.759326 15253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:44315: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab.
Entry for principal kudu/127.24.190.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab.
I20260928 20:19:15.767361 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:44315
--webserver_interface=127.24.190.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab
--principal=kudu/127.24.190.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:40193
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:37553,127.24.190.61:38751,127.24.190.60:44315
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:19:15.808702 15253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } attempt: 1
I20260928 20:19:15.809289 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.809127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49934)
0928 20:19:15.809196 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.809250 (+ 54us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":40}
I20260928 20:19:15.809672 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.809575 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49944)
0928 20:19:15.809620 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.809648 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":30}
W20260928 20:19:15.809792 15253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:44315: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
I20260928 20:19:15.813225 15178 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } attempt: 3
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:19:15.820412 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.813486 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56984)
0928 20:19:15.813543 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.813562 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.813600 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.813791 (+ 191us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.813792 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.813959 (+ 167us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.814030 (+ 71us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.814031 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.814766 (+ 735us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.814767 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.815325 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.815326 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.815720 (+ 394us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.815721 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.815804 (+ 83us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.816331 (+ 527us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.816336 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.817616 (+ 1280us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.819374 (+ 1758us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.819375 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.819375 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.819546 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.819758 (+ 212us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.819759 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.819759 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.819820 (+ 61us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.820079 (+ 259us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.820079 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.820130 (+ 51us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.820215 (+ 85us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.820315 (+ 100us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 20:19:15.820410 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.813590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56984 (local address 127.24.190.61:38751)
0928 20:19:15.813651 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.813654 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.813664 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:19:15.813691 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.813696 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.813707 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.813782 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.814122 (+ 340us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.814674 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.815427 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.815645 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.815723 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.817705 (+ 1982us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.817706 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.817707 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.817714 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.819265 (+ 1551us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.819627 (+ 362us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.819628 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.819629 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.819685 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.819884 (+ 199us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.819885 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.819886 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.819999 (+ 113us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.820087 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.820239 (+ 152us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.820315 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":40}
I20260928 20:19:15.820820 15178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:15.821206 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.821073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49952)
0928 20:19:15.821148 (+ 75us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.821183 (+ 35us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
I20260928 20:19:15.821506 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.821451 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49960)
0928 20:19:15.821472 (+ 21us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.821493 (+ 21us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":13}
W20260928 20:19:15.821640 15178 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:44315: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
W20260928 20:19:15.852175 15260 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 20:19:15.852391 15260 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:15.852408 15260 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:15.852428 15260 flags.cc:425] Enabled unsafe flag: --never_fsync=true
I20260928 20:19:15.852793 15178 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } attempt: 1
I20260928 20:19:15.853211 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.853082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49968)
0928 20:19:15.853144 (+ 62us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.853183 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260928 20:19:15.853618 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.853538 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49982)
0928 20:19:15.853577 (+ 39us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.853602 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":29}
W20260928 20:19:15.853721 15178 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:44315: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
W20260928 20:19:15.853780 15260 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:15.853854 15260 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:15.853878 15260 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:15.853904 15260 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:15.853932 15260 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:15.855540 15260 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:40193
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:37553,127.24.190.61:38751,127.24.190.60:44315
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab
--principal=kudu/127.24.190.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:44315
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.190.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15260
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:15.855809 15260 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:15.856050 15260 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:15.861123 15265 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:15.861258 15260 server_base.cc:1034] running on GCE node
W20260928 20:19:15.861121 15266 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:15.861155 15268 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:15.861619 15260 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:15.861933 15260 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:15.863080 15260 hybrid_clock.cc:648] HybridClock initialized: now 1790626755863067 us; error 29 us; skew 500 ppm
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:15.865804 15260 init.cc:377] Logged in from keytab as kudu/127.24.190.60@KRBTEST.COM (short username kudu)
I20260928 20:19:15.866255 15260 webserver.cc:460] Webserver started at http://127.24.190.60:42205/ using document root <none> and password file <none>
I20260928 20:19:15.866535 15260 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:15.866580 15260 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:15.866719 15260 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:15.867781 15260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data/instance:
uuid: "b5b4d6f795b54828ae49a57c58549c5d"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "722f8e21f4a06852759ba4ee3a685592"
server_key_iv: "e4b2c107be0a7e0098f066f881cba135"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.868139 15260 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal/instance:
uuid: "b5b4d6f795b54828ae49a57c58549c5d"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "722f8e21f4a06852759ba4ee3a685592"
server_key_iv: "e4b2c107be0a7e0098f066f881cba135"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.869477 15260 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:19:15.870204 15275 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:15.870393 15260 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:19:15.870489 15260 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal
uuid: "b5b4d6f795b54828ae49a57c58549c5d"
format_stamp: "Formatted at 2026-09-28 20:19:15 on dist-test-slave-n45k"
server_key: "722f8e21f4a06852759ba4ee3a685592"
server_key_iv: "e4b2c107be0a7e0098f066f881cba135"
server_key_version: "encryptionkey@0"
I20260928 20:19:15.870563 15260 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:15.877969 15253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } attempt: 2
I20260928 20:19:15.878412 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.878252 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:49994)
0928 20:19:15.878346 (+ 94us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.878385 (+ 39us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260928 20:19:15.878762 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.878666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:50002)
0928 20:19:15.878711 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.878735 (+ 24us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 20:19:15.878854 15253 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:44315: Network error: Client connection negotiation failed: client connection to 127.24.190.60:44315: connect: Connection refused (error 111)
I20260928 20:19:15.882148 15260 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:15.883915 15260 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:15.884069 15260 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:15.888123 15260 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.60:44315
I20260928 20:19:15.888154 15327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.60:44315 every 8 connection(s)
I20260928 20:19:15.888497 15260 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
I20260928 20:19:15.889487 15328 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:15.891127 15328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:15.892283 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 15260
I20260928 20:19:15.892385 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1790626483051462-25336-0/minicluster-data/master-2/wal/instance
I20260928 20:19:15.892563 25336 external_mini_cluster.cc:1428] Setting key 5805a40bde8a42785fb18ec410427fb8
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:15.900892 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.891895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40404 (local address 127.24.190.62:37553)
0928 20:19:15.891956 (+ 61us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.891958 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.892236 (+ 278us) server_negotiation.cc:407] Connection header received
0928 20:19:15.892806 (+ 570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.892808 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.892821 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.892891 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.893536 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.894010 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.895009 (+ 999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.895200 (+ 191us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.895297 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.897653 (+ 2356us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.897654 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.897655 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.897664 (+ 9us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.899406 (+ 1742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.899880 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.899881 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.899882 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.899937 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.900229 (+ 292us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.900230 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.900230 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.900345 (+ 115us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.900441 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.900707 (+ 266us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.900792 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":35}
I20260928 20:19:15.901341 15330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.891864 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:37553 (local address 127.0.0.1:40404)
0928 20:19:15.892020 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.892060 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.892708 (+ 648us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.892989 (+ 281us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.892992 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.893236 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.893426 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.893430 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.894089 (+ 659us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.894090 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.894902 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.894904 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.895321 (+ 417us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.895322 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.895435 (+ 113us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.895910 (+ 475us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.895918 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.897520 (+ 1602us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.899487 (+ 1967us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.899494 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.899496 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.899788 (+ 292us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.900016 (+ 228us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.900016 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.900017 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.900156 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.900444 (+ 288us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.900451 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.900578 (+ 127us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.900686 (+ 108us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.900869 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":116,"thread_start_us":87,"threads_started":1}
I20260928 20:19:15.901580 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.893114 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50008 (local address 127.24.190.60:44315)
0928 20:19:15.893284 (+ 170us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.893288 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.893321 (+ 33us) server_negotiation.cc:407] Connection header received
0928 20:19:15.893339 (+ 18us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.893341 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.893356 (+ 15us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.893440 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.894043 (+ 603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.894890 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.895869 (+ 979us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.896155 (+ 286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.896238 (+ 83us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.898607 (+ 2369us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.898615 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.898615 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.898621 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.900306 (+ 1685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.900635 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.900639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.900639 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.900700 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.900898 (+ 198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.900898 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.900899 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.901075 (+ 176us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.901204 (+ 129us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.901370 (+ 166us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.901476 (+ 106us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":53,"server-negotiator.queue_time_us":141,"thread_start_us":102,"threads_started":1}
I20260928 20:19:15.901912 15328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:19:15.909297 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.902239 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56994 (local address 127.24.190.61:38751)
0928 20:19:15.902324 (+ 85us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.902326 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.902336 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:19:15.902361 (+ 25us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.902362 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.902372 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.902433 (+ 61us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.902859 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.903456 (+ 597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.904255 (+ 799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.904462 (+ 207us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.904513 (+ 51us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.906543 (+ 2030us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.906544 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.906544 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.906552 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.908149 (+ 1597us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.908500 (+ 351us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.908501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.908501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.908562 (+ 61us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.908791 (+ 229us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.908792 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.908792 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.908910 (+ 118us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.908986 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.909134 (+ 148us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.909202 (+ 68us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:19:15.909297 15330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.902159 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:38751 (local address 127.0.0.1:56994)
0928 20:19:15.902209 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.902220 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.902256 (+ 36us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.902448 (+ 192us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.902449 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.902697 (+ 248us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.902778 (+ 81us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.902780 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.903534 (+ 754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.903534 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.904173 (+ 639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.904175 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.904529 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.904530 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.904608 (+ 78us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.905040 (+ 432us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.905046 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.906456 (+ 1410us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.908254 (+ 1798us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.908255 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.908255 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.908429 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.908628 (+ 199us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.908629 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.908630 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.908686 (+ 56us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.908978 (+ 292us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.908979 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.909023 (+ 44us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.909107 (+ 84us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.909198 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34}
I20260928 20:19:15.909629 15328 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:15.909896 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.902592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40416 (local address 127.24.190.62:37553)
0928 20:19:15.902624 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.902626 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.902646 (+ 20us) server_negotiation.cc:407] Connection header received
0928 20:19:15.902663 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.902664 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.902672 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.902717 (+ 45us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.903204 (+ 487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.903775 (+ 571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.904603 (+ 828us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.904779 (+ 176us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.904857 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.907157 (+ 2300us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.907159 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.907159 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.907166 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.908649 (+ 1483us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.909003 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.909004 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.909004 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.909057 (+ 53us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.909262 (+ 205us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.909263 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.909263 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.909419 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.909588 (+ 169us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.909674 (+ 86us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.909749 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16}
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:19:15.916533 15330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.909871 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:50020)
0928 20:19:15.909909 (+ 38us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.909920 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.910129 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.910329 (+ 200us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.910329 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.910507 (+ 178us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.910544 (+ 37us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.910546 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.911144 (+ 598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.911145 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.911613 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.911614 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.911992 (+ 378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.911993 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.912040 (+ 47us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.912446 (+ 406us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.912450 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.913819 (+ 1369us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.915520 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.915521 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.915521 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.915721 (+ 200us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.915924 (+ 203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.915925 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.915925 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.915969 (+ 44us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.916206 (+ 237us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.916206 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.916249 (+ 43us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.916336 (+ 87us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.916425 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":21}
I20260928 20:19:15.916576 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.909951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50020 (local address 127.24.190.60:44315)
0928 20:19:15.909991 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.909993 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.910002 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:19:15.910211 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.910212 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.910221 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.910290 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.910603 (+ 313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.911068 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.911692 (+ 624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.911910 (+ 218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.911992 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.913902 (+ 1910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.913903 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.913903 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.913910 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.915422 (+ 1512us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.915809 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.915810 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.915811 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.915859 (+ 48us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.916044 (+ 185us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.916045 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.916045 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.916145 (+ 100us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.916213 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.916356 (+ 143us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.916470 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":56,"server-negotiator.queue_time_us":23}
I20260928 20:19:15.917649 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.910590 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57006 (local address 127.24.190.61:38751)
0928 20:19:15.910625 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.910627 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.910638 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:19:15.910711 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.910712 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.910721 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.910768 (+ 47us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.911226 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.911690 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.912369 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.912571 (+ 202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.912645 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.914949 (+ 2304us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.914950 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.914951 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.914958 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.916367 (+ 1409us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.916773 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.916774 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.916774 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.916833 (+ 59us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.917054 (+ 221us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.917055 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.917056 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.917198 (+ 142us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.917370 (+ 172us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.917415 (+ 45us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.917485 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:19:15.918378 15328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: Bootstrap starting.
I20260928 20:19:15.919170 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:15.919488 15328 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:15.919795 15328 log.cc:824] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:15.920552 15328 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: No bootstrap required, opened a new log
I20260928 20:19:15.920432 15152 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "c585cac7bcce49c2bfd17f412f53ac47"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:40416
I20260928 20:19:15.922022 15328 raft_consensus.cc:348] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.922147 15328 raft_consensus.cc:729] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b5b4d6f795b54828ae49a57c58549c5d, State: Initialized, Role: FOLLOWER
I20260928 20:19:15.922233 15328 consensus_queue.cc:260] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.922556 15334 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.922616 15328 sys_catalog.cc:564] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:15.922662 15334 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: This master's current role is: FOLLOWER
W20260928 20:19:15.924525 15345 catalog_manager.cc:1558] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:15.924577 15345 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:19:15.924902 15260 master_runner.cc:186] Error getting master registration for 127.24.190.62:37553: OK, instance_id { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" instance_seqno: 1790626755586483 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:19:15.927013 15260 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:19:15.928911 15178 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } attempt: 2
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:15.936859 15182 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.929251 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:50036)
0928 20:19:15.929320 (+ 69us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.929333 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.929390 (+ 57us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.929549 (+ 159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.929550 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.929748 (+ 198us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.929802 (+ 54us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.929804 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.930738 (+ 934us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.930739 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.931551 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.931553 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.932031 (+ 478us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.932032 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.932089 (+ 57us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.932591 (+ 502us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.932596 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.933804 (+ 1208us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.935714 (+ 1910us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.935715 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.935715 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.935937 (+ 222us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.936150 (+ 213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.936151 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.936151 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.936217 (+ 66us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.936534 (+ 317us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.936535 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.936578 (+ 43us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.936647 (+ 69us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.936745 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":42}
I20260928 20:19:15.936858 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.929332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50036 (local address 127.24.190.60:44315)
0928 20:19:15.929404 (+ 72us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.929406 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.929416 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:19:15.929444 (+ 28us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.929444 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.929455 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.929510 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.929888 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.930643 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.931638 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.931945 (+ 307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.932023 (+ 78us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.933887 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.933889 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.933889 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.933896 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.935623 (+ 1727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.936012 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.936013 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.936014 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.936074 (+ 60us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.936282 (+ 208us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.936283 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.936283 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.936465 (+ 182us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.936537 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.936690 (+ 153us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.936772 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":48}
I20260928 20:19:15.938546 15178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47: Bootstrap starting.
I20260928 20:19:15.939157 15178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:15.939455 15178 log.cc:824] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:15.940210 15178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47: No bootstrap required, opened a new log
I20260928 20:19:15.941238 15178 raft_consensus.cc:348] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.941375 15178 raft_consensus.cc:729] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c585cac7bcce49c2bfd17f412f53ac47, State: Initialized, Role: FOLLOWER
I20260928 20:19:15.941488 15178 consensus_queue.cc:260] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.941752 15348 sys_catalog.cc:455] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.941819 15178 sys_catalog.cc:564] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:15.941835 15348 sys_catalog.cc:458] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:15.941955 15152 raft_consensus.cc:482] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260928 20:19:15.942031 15152 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:15.942844 15152 raft_consensus.cc:504] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
W20260928 20:19:15.943890 15359 catalog_manager.cc:1558] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:15.943948 15359 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:19:15.946692 15302 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c585cac7bcce49c2bfd17f412f53ac47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "b5b4d6f795b54828ae49a57c58549c5d"
I20260928 20:19:15.946836 15302 raft_consensus.cc:3037] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:15.944744 15110 master_runner.cc:186] Error getting master registration for 127.24.190.61:38751: OK, instance_id { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" instance_seqno: 1790626755734495 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:19:15.947014 15110 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:19:15.947750 15302 raft_consensus.cc:2454] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c585cac7bcce49c2bfd17f412f53ac47 in term 1.
I20260928 20:19:15.947978 15152 leader_election.cc:288] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [CANDIDATE]: Term 1 election: Requested vote from peers 54d4d1e3491f457cab90f9ef7f4c08a1 (127.24.190.61:38751), b5b4d6f795b54828ae49a57c58549c5d (127.24.190.60:44315)
I20260928 20:19:15.947996 15129 leader_election.cc:302] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b5b4d6f795b54828ae49a57c58549c5d, c585cac7bcce49c2bfd17f412f53ac47; no voters:
I20260928 20:19:15.948174 15348 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:15.948325 15348 raft_consensus.cc:686] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [term 1 LEADER]: Becoming Leader. State: Replica: c585cac7bcce49c2bfd17f412f53ac47, State: Running, Role: LEADER
I20260928 20:19:15.948411 15348 consensus_queue.cc:237] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.949108 15361 sys_catalog.cc:455] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c585cac7bcce49c2bfd17f412f53ac47. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.949275 15361 sys_catalog.cc:458] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:15.959478 15257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.950187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57008 (local address 127.24.190.61:38751)
0928 20:19:15.950226 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.950228 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.951062 (+ 834us) server_negotiation.cc:407] Connection header received
0928 20:19:15.951159 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.951160 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.951169 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.951199 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.951916 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.952674 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.953727 (+ 1053us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.954014 (+ 287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.954056 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.956037 (+ 1981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.956039 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.956039 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.956046 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.958162 (+ 2116us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.958633 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.958635 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.958635 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.958692 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.958888 (+ 196us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.958888 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.958889 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.959013 (+ 124us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.959104 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.959296 (+ 192us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.959383 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19}
I20260928 20:19:15.960216 15181 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.949982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40428 (local address 127.24.190.62:37553)
0928 20:19:15.950020 (+ 38us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.950022 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.950827 (+ 805us) server_negotiation.cc:407] Connection header received
0928 20:19:15.950984 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.950986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.951009 (+ 23us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.951042 (+ 33us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.952217 (+ 1175us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.952951 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.954484 (+ 1533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.954779 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.954821 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.956877 (+ 2056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.956878 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.956879 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.956886 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.958485 (+ 1599us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.959137 (+ 652us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.959139 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.959139 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.959209 (+ 70us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.959500 (+ 291us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.959501 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.959501 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.959634 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.959717 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.960027 (+ 310us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.960126 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:19:15.962452 15363 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:15.962692 15363 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:15.967269 15302 raft_consensus.cc:1261] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [term 1 FOLLOWER]: Refusing update from remote peer c585cac7bcce49c2bfd17f412f53ac47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:19:15.967566 15361 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:19:15.968880 15334 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c585cac7bcce49c2bfd17f412f53ac47. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.968998 15334 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:15.969969 15253 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } attempt: 3
I20260928 20:19:15.970551 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.950801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50044 (local address 127.24.190.60:44315)
0928 20:19:15.950838 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.950840 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.960730 (+ 9890us) server_negotiation.cc:407] Connection header received
0928 20:19:15.960879 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.960880 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.960901 (+ 21us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.960930 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.961603 (+ 673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.962443 (+ 840us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.963969 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.964299 (+ 330us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.964348 (+ 49us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.966584 (+ 2236us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.966585 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.966586 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.966593 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.968523 (+ 1930us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.969238 (+ 715us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.969239 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.969240 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.969296 (+ 56us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.969591 (+ 295us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.969591 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.969592 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.969730 (+ 138us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.969800 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.970378 (+ 578us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.970463 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
Sep 28 20:19:15 dist-test-slave-n45k krb5kdc[15097](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626755, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:15.979035 15255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.970222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:44315 (local address 127.0.0.1:50046)
0928 20:19:15.970295 (+ 73us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:15.970307 (+ 12us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:15.970348 (+ 41us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:15.970711 (+ 363us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:15.970712 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:15.970870 (+ 158us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:15.970916 (+ 46us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.970919 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.971812 (+ 893us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.971813 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.972636 (+ 823us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:15.972638 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.973111 (+ 473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.973112 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:15.973181 (+ 69us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.973647 (+ 466us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:15.973664 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:15.975300 (+ 1636us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:15.977786 (+ 2486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.977787 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.977787 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.978017 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.978242 (+ 225us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:15.978242 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:15.978243 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:15.978348 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:15.978706 (+ 358us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:15.978707 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:15.978758 (+ 51us) client_negotiation.cc:769] Sending connection context
0928 20:19:15.978820 (+ 62us) client_negotiation.cc:240] Negotiation successful
0928 20:19:15.978924 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23}
I20260928 20:19:15.979456 15332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:15.970333 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50046 (local address 127.24.190.60:44315)
0928 20:19:15.970610 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:15.970612 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:15.970619 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:19:15.970636 (+ 17us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:15.970636 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:15.970645 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:15.970700 (+ 55us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:15.971021 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.971738 (+ 717us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.972720 (+ 982us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:15.973042 (+ 322us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:15.973106 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:15.975383 (+ 2277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:15.975384 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:15.975385 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:15.975392 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:15.976975 (+ 1583us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.978080 (+ 1105us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.978081 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.978081 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.978153 (+ 72us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:15.978429 (+ 276us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:15.978430 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:15.978431 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:15.978596 (+ 165us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:15.978665 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:15.978927 (+ 262us) server_negotiation.cc:299] Negotiation successful
0928 20:19:15.979054 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":265,"thread_start_us":71,"threads_started":1}
I20260928 20:19:15.979614 15361 sys_catalog.cc:455] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.979723 15361 sys_catalog.cc:458] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:15.979926 15371 mvcc.cc:205] Tried to move back new op lower bound from 7334407192439087104 to 7334407192365477888. Current Snapshot: MvccSnapshot[applied={T|T < 7334407192439087104}]
I20260928 20:19:15.980381 15334 sys_catalog.cc:455] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.980459 15334 sys_catalog.cc:458] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:15.981338 15253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: Bootstrap starting.
I20260928 20:19:15.982018 15253 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:15.982371 15253 log.cc:824] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:15.982748 15363 catalog_manager.cc:1347] Generated new cluster ID: fd8431ef1c3b4a8889cfaeccf6d5f9cb
I20260928 20:19:15.982801 15363 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:15.986896 15253 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: No bootstrap required, opened a new log
I20260928 20:19:15.988920 15253 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.989055 15253 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54d4d1e3491f457cab90f9ef7f4c08a1, State: Initialized, Role: FOLLOWER
I20260928 20:19:15.989131 15253 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } }
I20260928 20:19:15.989463 15253 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:15.990502 15227 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c585cac7bcce49c2bfd17f412f53ac47" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1"
I20260928 20:19:15.990612 15227 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:15.991498 15227 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c585cac7bcce49c2bfd17f412f53ac47 in term 1.
I20260928 20:19:15.992678 15226 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [term 1 FOLLOWER]: Refusing update from remote peer c585cac7bcce49c2bfd17f412f53ac47: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:19:15.992935 15348 consensus_queue.cc:1035] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:19:15.995645 15348 sys_catalog.cc:455] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.995728 15348 sys_catalog.cc:458] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47 [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:15.997175 15387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.997340 15387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:15.997435 15387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c585cac7bcce49c2bfd17f412f53ac47. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.997531 15387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:15.997597 15387 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c585cac7bcce49c2bfd17f412f53ac47" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c585cac7bcce49c2bfd17f412f53ac47" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 37553 } } peers { permanent_uuid: "54d4d1e3491f457cab90f9ef7f4c08a1" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 38751 } } peers { permanent_uuid: "b5b4d6f795b54828ae49a57c58549c5d" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 44315 } } }
I20260928 20:19:15.997685 15387 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:15.997774 15363 catalog_manager.cc:1370] Generated new certificate authority record
W20260928 20:19:15.998355 15393 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:15.998495 15393 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:19:15.998502 15363 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:15.998667 15385 mvcc.cc:205] Tried to move back new op lower bound from 7334407192439087104 to 7334407192365477888. Current Snapshot: MvccSnapshot[applied={T|T < 7334407192439087104}]
I20260928 20:19:16.006505 15363 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c585cac7bcce49c2bfd17f412f53ac47: Generated new TSK 0
I20260928 20:19:16.006686 15363 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260928 20:19:16.025939 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.024366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57010 (local address 127.24.190.61:38751)
0928 20:19:16.024407 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.024409 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.025254 (+ 845us) server_negotiation.cc:407] Connection header received
0928 20:19:16.025368 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.025370 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.025380 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.025411 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.025857 (+ 446us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57010: BlockingRecv error: recv got EOF from 127.0.0.1:57010 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 20:19:16.026893 15332 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.024690 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50058 (local address 127.24.190.60:44315)
0928 20:19:16.024729 (+ 39us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.024731 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.026346 (+ 1615us) server_negotiation.cc:407] Connection header received
0928 20:19:16.026459 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.026460 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.026470 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.026499 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.026834 (+ 335us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50058: BlockingRecv error: recv got EOF from 127.0.0.1:50058 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260928 20:19:16.027750 15181 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.024880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40442 (local address 127.24.190.62:37553)
0928 20:19:16.024917 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.024920 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.027262 (+ 2342us) server_negotiation.cc:407] Connection header received
0928 20:19:16.027368 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.027369 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.027379 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.027407 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.027690 (+ 283us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:40442: BlockingRecv error: recv got EOF from 127.0.0.1:40442 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260928 20:19:16.031688 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.030905 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57026 (local address 127.24.190.61:38751)
0928 20:19:16.030953 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.030955 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.031138 (+ 183us) server_negotiation.cc:407] Connection header received
0928 20:19:16.031249 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.031250 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.031269 (+ 19us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.031300 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.031639 (+ 339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57026: BlockingRecv error: recv got EOF from 127.0.0.1:57026 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 20:19:16.034895 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.034057 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57036 (local address 127.24.190.61:38751)
0928 20:19:16.034091 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.034092 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.034384 (+ 292us) server_negotiation.cc:407] Connection header received
0928 20:19:16.034484 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.034485 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.034496 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.034526 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.034845 (+ 319us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57036: BlockingRecv error: recv got EOF from 127.0.0.1:57036 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260928 20:19:16.038774 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.038006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57042 (local address 127.24.190.61:38751)
0928 20:19:16.038039 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.038040 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.038290 (+ 250us) server_negotiation.cc:407] Connection header received
0928 20:19:16.038401 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.038402 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.038412 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.038439 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.038730 (+ 291us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57042: BlockingRecv error: recv got EOF from 127.0.0.1:57042 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260928 20:19:16.044690 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.043885 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57050 (local address 127.24.190.61:38751)
0928 20:19:16.043920 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.043922 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.044174 (+ 252us) server_negotiation.cc:407] Connection header received
0928 20:19:16.044270 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.044271 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.044281 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.044321 (+ 40us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.044645 (+ 324us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57050: BlockingRecv error: recv got EOF from 127.0.0.1:57050 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 20:19:16.054914 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.053963 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57056 (local address 127.24.190.61:38751)
0928 20:19:16.054003 (+ 40us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.054005 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.054328 (+ 323us) server_negotiation.cc:407] Connection header received
0928 20:19:16.054438 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.054439 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.054450 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.054481 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.054847 (+ 366us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57056: BlockingRecv error: recv got EOF from 127.0.0.1:57056 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260928 20:19:16.073415 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.072381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57062 (local address 127.24.190.61:38751)
0928 20:19:16.072426 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.072429 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.072708 (+ 279us) server_negotiation.cc:407] Connection header received
0928 20:19:16.072814 (+ 106us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.072815 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.072826 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.072857 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.073349 (+ 492us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57062: BlockingRecv error: recv got EOF from 127.0.0.1:57062 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 20:19:16.107666 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.106878 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57068 (local address 127.24.190.61:38751)
0928 20:19:16.106926 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.106928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.107056 (+ 128us) server_negotiation.cc:407] Connection header received
0928 20:19:16.107141 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.107143 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.107161 (+ 18us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.107243 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.107608 (+ 365us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57068: BlockingRecv error: recv got EOF from 127.0.0.1:57068 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260928 20:19:16.173813 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.173004 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57080 (local address 127.24.190.61:38751)
0928 20:19:16.173064 (+ 60us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.173066 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.173161 (+ 95us) server_negotiation.cc:407] Connection header received
0928 20:19:16.173251 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.173252 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.173265 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.173346 (+ 81us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.173755 (+ 409us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57080: BlockingRecv error: recv got EOF from 127.0.0.1:57080 (error 108)
Metrics: {"server-negotiator.queue_time_us":34}
W20260928 20:19:16.303769 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.303085 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57084 (local address 127.24.190.61:38751)
0928 20:19:16.303132 (+ 47us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.303135 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.303302 (+ 167us) server_negotiation.cc:407] Connection header received
0928 20:19:16.303346 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.303347 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.303358 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.303410 (+ 52us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.303716 (+ 306us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57084: BlockingRecv error: recv got EOF from 127.0.0.1:57084 (error 108)
Metrics: {"server-negotiator.queue_time_us":21}
W20260928 20:19:16.561671 15257 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:16.560997 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57096 (local address 127.24.190.61:38751)
0928 20:19:16.561097 (+ 100us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:16.561099 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:16.561110 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:19:16.561141 (+ 31us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:16.561142 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:16.561154 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:16.561233 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:16.561622 (+ 389us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:57096: BlockingRecv error: recv got EOF from 127.0.0.1:57096 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
I20260928 20:19:16.924991 15345 catalog_manager.cc:1259] Loaded cluster ID: fd8431ef1c3b4a8889cfaeccf6d5f9cb
I20260928 20:19:16.925066 15345 catalog_manager.cc:1552] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: loading cluster ID for follower catalog manager: success
I20260928 20:19:16.925828 15345 catalog_manager.cc:1574] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: acquiring CA information for follower catalog manager: success
I20260928 20:19:16.926077 15345 catalog_manager.cc:1602] T 00000000000000000000000000000000 P b5b4d6f795b54828ae49a57c58549c5d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:19:16.999061 15393 catalog_manager.cc:1259] Loaded cluster ID: fd8431ef1c3b4a8889cfaeccf6d5f9cb
I20260928 20:19:16.999148 15393 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: loading cluster ID for follower catalog manager: success
I20260928 20:19:17.000090 15393 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: acquiring CA information for follower catalog manager: success
I20260928 20:19:17.000433 15393 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 54d4d1e3491f457cab90f9ef7f4c08a1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:19:17.077801 15461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:17.075039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57102 (local address 127.24.190.61:38751)
0928 20:19:17.075173 (+ 134us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:17.075175 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:17.075241 (+ 66us) server_negotiation.cc:407] Connection header received
0928 20:19:17.075289 (+ 48us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:17.075290 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:17.075336 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:17.075424 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:17.075563 (+ 139us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.076095 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.076978 (+ 883us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.077211 (+ 233us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.077273 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:17.077477 (+ 204us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:17.077582 (+ 105us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:17.077647 (+ 65us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:17.077713 (+ 66us) server_negotiation.cc:299] Negotiation successful
0928 20:19:17.077731 (+ 18us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105,"thread_start_us":85,"threads_started":1}
I20260928 20:19:17.082576 15467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:17.080032 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50068 (local address 127.24.190.60:44315)
0928 20:19:17.080170 (+ 138us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:17.080172 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:17.080197 (+ 25us) server_negotiation.cc:407] Connection header received
0928 20:19:17.080239 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:17.080240 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:17.080291 (+ 51us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:17.080381 (+ 90us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:17.080477 (+ 96us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.080963 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.081717 (+ 754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.081934 (+ 217us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.082016 (+ 82us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:17.082186 (+ 170us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:17.082333 (+ 147us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:17.082423 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:17.082461 (+ 38us) server_negotiation.cc:299] Negotiation successful
0928 20:19:17.082482 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":115,"thread_start_us":69,"threads_started":1}
I20260928 20:19:17.087975 15473 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:17.084596 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40458 (local address 127.24.190.62:37553)
0928 20:19:17.084744 (+ 148us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:17.084746 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:17.084860 (+ 114us) server_negotiation.cc:407] Connection header received
0928 20:19:17.085028 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:17.085030 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:17.085088 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:17.085186 (+ 98us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:17.085362 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.085970 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.086874 (+ 904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.087093 (+ 219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.087185 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:17.087407 (+ 222us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:17.087498 (+ 91us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:17.087581 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:17.087852 (+ 271us) server_negotiation.cc:299] Negotiation successful
0928 20:19:17.087879 (+ 27us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":126,"thread_start_us":65,"threads_started":1}
I20260928 20:19:17.088661 15461 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:17.084645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57110 (local address 127.24.190.61:38751)
0928 20:19:17.084687 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:17.084689 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:17.085064 (+ 375us) server_negotiation.cc:407] Connection header received
0928 20:19:17.085393 (+ 329us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:17.085395 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:17.085405 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:17.085455 (+ 50us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:17.085604 (+ 149us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.086437 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.087774 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.088129 (+ 355us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.088197 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:17.088394 (+ 197us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:17.088432 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:17.088502 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:17.088550 (+ 48us) server_negotiation.cc:299] Negotiation successful
0928 20:19:17.088576 (+ 26us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:19:17.088907 15467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:17.084947 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50076 (local address 127.24.190.60:44315)
0928 20:19:17.085017 (+ 70us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:17.085019 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:17.085029 (+ 10us) server_negotiation.cc:407] Connection header received
0928 20:19:17.085128 (+ 99us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:17.085129 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:17.085141 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:17.085201 (+ 60us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:17.085524 (+ 323us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.086381 (+ 857us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.087918 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:17.088242 (+ 324us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:17.088319 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:17.088506 (+ 187us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:17.088544 (+ 38us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:17.088577 (+ 33us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:17.088713 (+ 136us) server_negotiation.cc:299] Negotiation successful
0928 20:19:17.088830 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260928 20:19:17.090402 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 15110
I20260928 20:19:17.096051 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 15185
I20260928 20:19:17.103291 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 15260
2026-09-28T20:19:17Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (2858 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Sep 28 20:19:17 dist-test-slave-n45k krb5kdc[15478](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Sep 28 20:19:17 dist-test-slave-n45k krb5kdc[15478](info): set up 2 sockets
Sep 28 20:19:17 dist-test-slave-n45k krb5kdc[15478](info): commencing operation
krb5kdc: starting...
W20260928 20:19:18.183172 25336 mini_kdc.cc:121] Time spent starting KDC: real 1.059s user 0.000s sys 0.005s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/test-user.keytab.
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-09-28T20:19:18Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-09-28T20:19:18Z Disabled control of system clock
WARNING: no policy specified for kudu/127.24.190.62@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.62@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
Entry for principal kudu/127.24.190.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab.
I20260928 20:19:18.306118 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41057
--webserver_interface=127.24.190.62
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41057,127.24.190.61:46661,127.24.190.60:35421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260928 20:19:18.387638 15491 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 20:19:18.387843 15491 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:18.387862 15491 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:18.387884 15491 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:18.388926 15491 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:18.388959 15491 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:18.388973 15491 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:18.388986 15491 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:18.388998 15491 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:18.390476 15491 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41057,127.24.190.61:46661,127.24.190.60:35421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.62.keytab
--principal=kudu/127.24.190.62
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.62:41057
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.24.190.62
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15491
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:18.390702 15491 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:18.390925 15491 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:18.395692 15497 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:18.395694 15499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:18.395794 15491 server_base.cc:1034] running on GCE node
W20260928 20:19:18.395754 15496 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:18.396131 15491 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:18.396370 15491 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:18.397534 15491 hybrid_clock.cc:648] HybridClock initialized: now 1790626758397523 us; error 28 us; skew 500 ppm
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:18.404273 15491 init.cc:377] Logged in from keytab as kudu/127.24.190.62@KRBTEST.COM (short username kudu)
I20260928 20:19:18.404778 15491 webserver.cc:460] Webserver started at http://127.24.190.62:43919/ using document root <none> and password file <none>
I20260928 20:19:18.405045 15491 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:18.405120 15491 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:18.405277 15491 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:18.406445 15491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data/instance:
uuid: "adcb0535b86e41dda1598470f3a63e5b"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "c82eab59a254ce22b511d84840afb13a"
server_key_iv: "912469d2222e1da61a315419cb57a58b"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.406817 15491 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal/instance:
uuid: "adcb0535b86e41dda1598470f3a63e5b"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "c82eab59a254ce22b511d84840afb13a"
server_key_iv: "912469d2222e1da61a315419cb57a58b"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.408221 15491 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s
I20260928 20:19:18.408978 15506 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:18.409152 15491 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:19:18.409258 15491 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal
uuid: "adcb0535b86e41dda1598470f3a63e5b"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "c82eab59a254ce22b511d84840afb13a"
server_key_iv: "912469d2222e1da61a315419cb57a58b"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.409332 15491 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:18.423147 15491 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:18.425500 15491 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:18.425674 15491 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:18.429885 15491 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.62:41057
I20260928 20:19:18.430012 15558 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.62:41057 every 8 connection(s)
I20260928 20:19:18.430344 15491 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/data/info.pb
I20260928 20:19:18.430944 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 15491
I20260928 20:19:18.431062 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-0/wal/instance
I20260928 20:19:18.431241 25336 external_mini_cluster.cc:1428] Setting key e2048173887ee4089f3bf2626a859b10
I20260928 20:19:18.431496 15559 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:18.432996 15559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.190.61@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.61@KRBTEST.COM" created.
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:19:18.445483 15563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.433737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53086 (local address 127.24.190.62:41057)
0928 20:19:18.433925 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.433935 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.434012 (+ 77us) server_negotiation.cc:407] Connection header received
0928 20:19:18.434666 (+ 654us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.434668 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.434688 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.434796 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.435346 (+ 550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.436152 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.437009 (+ 857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.437328 (+ 319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.437463 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.442232 (+ 4769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.442240 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.442240 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.442254 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.443860 (+ 1606us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.444287 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.444290 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.444291 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.444369 (+ 78us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.444608 (+ 239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.444609 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.444609 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.444819 (+ 210us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.444914 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.445107 (+ 193us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.445239 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":160,"thread_start_us":96,"threads_started":1}
I20260928 20:19:18.445482 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.433704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41057 (local address 127.0.0.1:53086)
0928 20:19:18.433889 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.433930 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.434504 (+ 574us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.434801 (+ 297us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.434804 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.435080 (+ 276us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.435227 (+ 147us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.435231 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.436249 (+ 1018us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.436250 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.436912 (+ 662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.436914 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.437453 (+ 539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.437454 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.437514 (+ 60us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.438086 (+ 572us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.438096 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.442121 (+ 4025us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.443987 (+ 1866us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.443992 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.443994 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.444190 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.444439 (+ 249us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.444440 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.444440 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.444527 (+ 87us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.444893 (+ 366us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.444898 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.444959 (+ 61us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.445067 (+ 108us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.445302 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":141,"mutex_wait_us":97,"thread_start_us":89,"threads_started":1}
I20260928 20:19:18.446846 15559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:18.447188 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.447073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37682)
0928 20:19:18.447125 (+ 52us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.447167 (+ 42us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
W20260928 20:19:18.447319 15510 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
I20260928 20:19:18.447718 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.447619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37698)
0928 20:19:18.447665 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.447690 (+ 25us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
W20260928 20:19:18.447818 15559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:46661: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab.
Entry for principal kudu/127.24.190.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab.
I20260928 20:19:18.457731 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:46661
--webserver_interface=127.24.190.61
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab
--principal=kudu/127.24.190.61
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41057,127.24.190.61:46661,127.24.190.60:35421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:19:18.497036 15559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } attempt: 1
I20260928 20:19:18.497591 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.497448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37704)
0928 20:19:18.497514 (+ 66us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.497558 (+ 44us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
I20260928 20:19:18.497989 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.497899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37720)
0928 20:19:18.497945 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.497972 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
W20260928 20:19:18.498122 15559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:46661: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
W20260928 20:19:18.541309 15566 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 20:19:18.541531 15566 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:18.541548 15566 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:18.541569 15566 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:18.542695 15566 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:18.542729 15566 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:18.542743 15566 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:18.542757 15566 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:18.542768 15566 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:18.544188 15566 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41057,127.24.190.61:46661,127.24.190.60:35421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.61.keytab
--principal=kudu/127.24.190.61
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.61:46661
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.24.190.61
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15566
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:18.544384 15566 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:18.544559 15566 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:18.549590 15574 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:18.549633 15572 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:18.549826 15571 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:18.549997 15566 server_base.cc:1034] running on GCE node
I20260928 20:19:18.550362 15566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:18.550626 15566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:18.551822 15566 hybrid_clock.cc:648] HybridClock initialized: now 1790626758551783 us; error 77 us; skew 500 ppm
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:18.554518 15566 init.cc:377] Logged in from keytab as kudu/127.24.190.61@KRBTEST.COM (short username kudu)
I20260928 20:19:18.555009 15566 webserver.cc:460] Webserver started at http://127.24.190.61:40419/ using document root <none> and password file <none>
I20260928 20:19:18.555254 15566 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:18.555322 15566 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:18.555469 15566 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:18.556535 15566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data/instance:
uuid: "6f3a97f55e29429ba7e47ce6711ed79a"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "8d3945c13b44ed2a23ddd0d271b751ad"
server_key_iv: "5747bb6876d5714fa24bdd7a158752f1"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.556898 15566 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal/instance:
uuid: "6f3a97f55e29429ba7e47ce6711ed79a"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "8d3945c13b44ed2a23ddd0d271b751ad"
server_key_iv: "5747bb6876d5714fa24bdd7a158752f1"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.558353 15566 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s
I20260928 20:19:18.559092 15581 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:18.559263 15566 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s
I20260928 20:19:18.559361 15566 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal
uuid: "6f3a97f55e29429ba7e47ce6711ed79a"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "8d3945c13b44ed2a23ddd0d271b751ad"
server_key_iv: "5747bb6876d5714fa24bdd7a158752f1"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.559442 15566 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:18.566330 15559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } attempt: 2
I20260928 20:19:18.566748 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.566619 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37736)
0928 20:19:18.566677 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.566708 (+ 31us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":36}
I20260928 20:19:18.567049 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.566959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37740)
0928 20:19:18.567004 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.567027 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 20:19:18.567143 15559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.61:46661: Network error: Client connection negotiation failed: client connection to 127.24.190.61:46661: connect: Connection refused (error 111)
I20260928 20:19:18.584743 15566 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:18.586742 15566 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:18.586913 15566 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:18.591037 15566 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.61:46661
I20260928 20:19:18.591073 15633 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.61:46661 every 8 connection(s)
I20260928 20:19:18.591480 15566 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/data/info.pb
I20260928 20:19:18.592574 15634 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:18.592790 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 15566
I20260928 20:19:18.592891 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-1/wal/instance
I20260928 20:19:18.593096 25336 external_mini_cluster.cc:1428] Setting key a7136feb116ec70009f7faf85b9d7b87
I20260928 20:19:18.594251 15634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.24.190.60@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.24.190.60@KRBTEST.COM" created.
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:19:18.606977 15563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.595051 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53100 (local address 127.24.190.62:41057)
0928 20:19:18.595114 (+ 63us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.595116 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.595465 (+ 349us) server_negotiation.cc:407] Connection header received
0928 20:19:18.595976 (+ 511us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.595978 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.595995 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.596045 (+ 50us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.596645 (+ 600us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.597148 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.598157 (+ 1009us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.598435 (+ 278us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.598522 (+ 87us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.603581 (+ 5059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.603584 (+ 3us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.603584 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.603594 (+ 10us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.605426 (+ 1832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.605903 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.605904 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.605904 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.605972 (+ 68us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.606284 (+ 312us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.606286 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.606286 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.606416 (+ 130us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.606496 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.606791 (+ 295us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.606880 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":32}
I20260928 20:19:18.607170 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.595028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41057 (local address 127.0.0.1:53100)
0928 20:19:18.595231 (+ 203us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.595276 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.595857 (+ 581us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.596115 (+ 258us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.596118 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.596362 (+ 244us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.596545 (+ 183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.596549 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.597251 (+ 702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.597252 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.598051 (+ 799us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.598052 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.598546 (+ 494us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.598547 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.598675 (+ 128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.599208 (+ 533us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.599216 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.603464 (+ 4248us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.605528 (+ 2064us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.605536 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.605538 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.605808 (+ 270us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.606043 (+ 235us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.606044 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.606044 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.606149 (+ 105us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.606487 (+ 338us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.606494 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.606633 (+ 139us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.606764 (+ 131us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.606927 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":166,"thread_start_us":110,"threads_started":1}
I20260928 20:19:18.607985 15634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } has no permanent_uuid. Determining permanent_uuid...
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:19:18.616466 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.608307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37742)
0928 20:19:18.608360 (+ 53us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.608370 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.608407 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.608758 (+ 351us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.608759 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.608899 (+ 140us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.608942 (+ 43us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.608943 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.609825 (+ 882us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.609825 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.610385 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.610388 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.610875 (+ 487us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.610876 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.610937 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.611349 (+ 412us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.611353 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.613250 (+ 1897us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.615364 (+ 2114us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.615365 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.615365 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.615546 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.615823 (+ 277us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.615823 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.615824 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.615884 (+ 60us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.616214 (+ 330us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.616215 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.616255 (+ 40us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.616313 (+ 58us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.616397 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":35}
I20260928 20:19:18.616557 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.608469 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37742 (local address 127.24.190.61:46661)
0928 20:19:18.608614 (+ 145us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.608618 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.608635 (+ 17us) server_negotiation.cc:407] Connection header received
0928 20:19:18.608662 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.608664 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.608674 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.608759 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.609025 (+ 266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.609735 (+ 710us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.610478 (+ 743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.610787 (+ 309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.610875 (+ 88us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.613355 (+ 2480us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.613364 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.613364 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.613372 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.615255 (+ 1883us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.615674 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.615677 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.615678 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.615741 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.615954 (+ 213us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.615955 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.615955 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.616145 (+ 190us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.616214 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.616349 (+ 135us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.616461 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":117,"thread_start_us":89,"threads_started":1}
I20260928 20:19:18.617390 15634 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:18.617777 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.617620 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33712)
0928 20:19:18.617677 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.617748 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":18}
W20260928 20:19:18.617934 15585 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
I20260928 20:19:18.618654 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.618533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33724)
0928 20:19:18.618600 (+ 67us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.618630 (+ 30us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260928 20:19:18.618808 15634 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:35421: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.24.190.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab.
Entry for principal kudu/127.24.190.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab.
I20260928 20:19:18.621111 25336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskJmbe_f/build/release/bin/kudu
/tmp/dist-test-taskJmbe_f/build/release/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:35421
--webserver_interface=127.24.190.60
--webserver_port=0
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab
--principal=kudu/127.24.190.60
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.24.190.20:42473
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.24.190.62:41057,127.24.190.61:46661,127.24.190.60:35421
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260928 20:19:18.658332 15559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } attempt: 3
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:19:18.666321 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.658793 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37744)
0928 20:19:18.658871 (+ 78us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.658882 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.658959 (+ 77us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.659198 (+ 239us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.659199 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.659355 (+ 156us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.659420 (+ 65us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.659421 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.660137 (+ 716us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.660139 (+ 2us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.660683 (+ 544us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.660685 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.661107 (+ 422us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.661108 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.661187 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.661684 (+ 497us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.661694 (+ 10us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.663278 (+ 1584us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.665123 (+ 1845us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.665124 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.665125 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.665368 (+ 243us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.665615 (+ 247us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.665616 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.665617 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.665694 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.665968 (+ 274us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.665968 (+ 0us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.666019 (+ 51us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.666090 (+ 71us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.666193 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":46}
I20260928 20:19:18.666568 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.658865 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37744 (local address 127.24.190.61:46661)
0928 20:19:18.658936 (+ 71us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.658938 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.658949 (+ 11us) server_negotiation.cc:407] Connection header received
0928 20:19:18.659029 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.659030 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.659042 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.659100 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.659519 (+ 419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.660014 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.660770 (+ 756us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.660994 (+ 224us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.661108 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.663363 (+ 2255us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.663365 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.663365 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.663371 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.665025 (+ 1654us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.665468 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.665469 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.665470 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.665534 (+ 64us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.665775 (+ 241us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.665776 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.665777 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.665898 (+ 121us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.665962 (+ 64us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.666196 (+ 234us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.666263 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":45}
I20260928 20:19:18.666929 15559 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:18.667287 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.667183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33740)
0928 20:19:18.667234 (+ 51us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.667261 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":34}
I20260928 20:19:18.667614 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.667504 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33756)
0928 20:19:18.667545 (+ 41us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.667567 (+ 22us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260928 20:19:18.667722 15559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:35421: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
I20260928 20:19:18.668042 15634 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } attempt: 1
I20260928 20:19:18.668395 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.668296 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33760)
0928 20:19:18.668342 (+ 46us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.668365 (+ 23us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":32}
I20260928 20:19:18.668792 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.668695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33768)
0928 20:19:18.668739 (+ 44us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.668766 (+ 27us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":31}
W20260928 20:19:18.668932 15634 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:35421: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
I20260928 20:19:18.698881 15559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } attempt: 1
I20260928 20:19:18.699466 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.699293 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33774)
0928 20:19:18.699391 (+ 98us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.699434 (+ 43us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260928 20:19:18.699893 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.699785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33790)
0928 20:19:18.699842 (+ 57us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.699870 (+ 28us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":41}
W20260928 20:19:18.700019 15559 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:35421: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
W20260928 20:19:18.705117 15641 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260928 20:19:18.705364 15641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260928 20:19:18.705401 15641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260928 20:19:18.705441 15641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260928 20:19:18.706650 15641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260928 20:19:18.706712 15641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260928 20:19:18.706737 15641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260928 20:19:18.706768 15641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260928 20:19:18.706791 15641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260928 20:19:18.708319 15641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.24.190.20:42473
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.24.190.62:41057,127.24.190.61:46661,127.24.190.60:35421
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/krb5kdc/kudu_127.24.190.60.keytab
--principal=kudu/127.24.190.60
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.24.190.60:35421
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.24.190.60
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--heap_profile_path=/tmp/kudu.15641
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type RELEASE
built by systest at 28 Sep 2026 19:10:17 UTC on ccycloud.quasar-awmulw.root.comops.site
build id 4677981
I20260928 20:19:18.708611 15641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260928 20:19:18.708837 15641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260928 20:19:18.714043 15646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:18.714115 15641 server_base.cc:1034] running on GCE node
W20260928 20:19:18.714053 15647 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260928 20:19:18.714053 15649 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260928 20:19:18.714664 15641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260928 20:19:18.714985 15641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260928 20:19:18.716192 15641 hybrid_clock.cc:648] HybridClock initialized: now 1790626758716168 us; error 31 us; skew 500 ppm
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260928 20:19:18.718900 15641 init.cc:377] Logged in from keytab as kudu/127.24.190.60@KRBTEST.COM (short username kudu)
I20260928 20:19:18.719408 15641 webserver.cc:460] Webserver started at http://127.24.190.60:37755/ using document root <none> and password file <none>
I20260928 20:19:18.719671 15641 fs_manager.cc:359] Metadata directory not provided
I20260928 20:19:18.719746 15641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260928 20:19:18.719913 15641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260928 20:19:18.721067 15641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data/instance:
uuid: "54cb6757dca242438f6b2ef33638d378"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "956bad8ddcb1ba1fd856d470af973c97"
server_key_iv: "0476c7e9151706e582d303fffb49f3e0"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.721457 15641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal/instance:
uuid: "54cb6757dca242438f6b2ef33638d378"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "956bad8ddcb1ba1fd856d470af973c97"
server_key_iv: "0476c7e9151706e582d303fffb49f3e0"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.723011 15641 fs_manager.cc:691] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s
I20260928 20:19:18.723896 15656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260928 20:19:18.724063 15641 fs_manager.cc:725] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s
I20260928 20:19:18.724179 15641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data,/tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal
uuid: "54cb6757dca242438f6b2ef33638d378"
format_stamp: "Formatted at 2026-09-28 20:19:18 on dist-test-slave-n45k"
server_key: "956bad8ddcb1ba1fd856d470af973c97"
server_key_iv: "0476c7e9151706e582d303fffb49f3e0"
server_key_version: "encryptionkey@0"
I20260928 20:19:18.724263 15641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260928 20:19:18.733670 15641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260928 20:19:18.735839 15641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260928 20:19:18.736016 15641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260928 20:19:18.737071 15634 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } attempt: 2
I20260928 20:19:18.737473 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.737348 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33794)
0928 20:19:18.737406 (+ 58us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.737443 (+ 37us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":37}
I20260928 20:19:18.737840 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.737723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33800)
0928 20:19:18.737786 (+ 63us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.737815 (+ 29us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260928 20:19:18.737928 15634 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.190.60:35421: Network error: Client connection negotiation failed: client connection to 127.24.190.60:35421: connect: Connection refused (error 111)
I20260928 20:19:18.740532 15641 rpc_server.cc:307] RPC server started. Bound to: 127.24.190.60:35421
I20260928 20:19:18.740592 15708 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.190.60:35421 every 8 connection(s)
I20260928 20:19:18.740971 15641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/data/info.pb
I20260928 20:19:18.742017 15709 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260928 20:19:18.743629 15709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:18.745882 25336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskJmbe_f/build/release/bin/kudu as pid 15641
I20260928 20:19:18.745999 25336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskJmbe_f/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1790626483051462-25336-0/minicluster-data/master-2/wal/instance
I20260928 20:19:18.746191 25336 external_mini_cluster.cc:1428] Setting key bf4187a7f69b9035f27cfe5a85bd16bd
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:18.753929 15563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.744365 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53110 (local address 127.24.190.62:41057)
0928 20:19:18.744427 (+ 62us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.744429 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.744564 (+ 135us) server_negotiation.cc:407] Connection header received
0928 20:19:18.744984 (+ 420us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.744986 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.744995 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.745055 (+ 60us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.745739 (+ 684us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.746567 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.748039 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.748374 (+ 335us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.748465 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.750958 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.750960 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.750960 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.750968 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.752505 (+ 1537us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.752911 (+ 406us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.752913 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.752913 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.752976 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.753228 (+ 252us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.753229 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.753229 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.753379 (+ 150us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.753459 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.753736 (+ 277us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.753826 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":37}
I20260928 20:19:18.754136 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.744270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.62:41057 (local address 127.0.0.1:53110)
0928 20:19:18.744431 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.744473 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.744903 (+ 430us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.745120 (+ 217us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.745123 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.745401 (+ 278us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.745608 (+ 207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.745613 (+ 5us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.746683 (+ 1070us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.746684 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.747943 (+ 1259us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.747946 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.748488 (+ 542us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.748488 (+ 0us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.748591 (+ 103us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.749219 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.749227 (+ 8us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.750861 (+ 1634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.752588 (+ 1727us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.752594 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.752596 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.752824 (+ 228us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.753047 (+ 223us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.753048 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.753048 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.753159 (+ 111us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.753459 (+ 300us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.753467 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.753604 (+ 137us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.753713 (+ 109us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.753903 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":122,"thread_start_us":94,"threads_started":1}
I20260928 20:19:18.754724 15709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:18.755723 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.746642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33802 (local address 127.24.190.60:35421)
0928 20:19:18.746821 (+ 179us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.746826 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.746852 (+ 26us) server_negotiation.cc:407] Connection header received
0928 20:19:18.746873 (+ 21us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.746875 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.746902 (+ 27us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.746970 (+ 68us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.747747 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.748823 (+ 1076us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.749646 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.750020 (+ 374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.750078 (+ 58us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.752493 (+ 2415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.752501 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.752502 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.752509 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.754152 (+ 1643us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.754567 (+ 415us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.754570 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.754570 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.754627 (+ 57us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.754869 (+ 242us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.754870 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.754870 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.755050 (+ 180us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.755180 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.755576 (+ 396us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.755656 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":148,"thread_start_us":113,"threads_started":1}
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.62@KRBTEST.COM
I20260928 20:19:18.762101 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.755056 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37760 (local address 127.24.190.61:46661)
0928 20:19:18.755107 (+ 51us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.755109 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.755117 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:19:18.755140 (+ 23us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.755141 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.755150 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.755221 (+ 71us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.755503 (+ 282us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.756072 (+ 569us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.756945 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.757273 (+ 328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.757354 (+ 81us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.759301 (+ 1947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.759302 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.759302 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.759308 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.760814 (+ 1506us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.761112 (+ 298us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.761113 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.761114 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.761169 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.761395 (+ 226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.761396 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.761397 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.761544 (+ 147us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.761618 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.761897 (+ 279us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.761964 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24}
I20260928 20:19:18.762324 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.754976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.61:46661 (local address 127.0.0.1:37760)
0928 20:19:18.755021 (+ 45us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.755031 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.755065 (+ 34us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.755223 (+ 158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.755224 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.755369 (+ 145us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.755422 (+ 53us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.755424 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.756148 (+ 724us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.756149 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.756860 (+ 711us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.756863 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.757374 (+ 511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.757375 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.757436 (+ 61us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.757780 (+ 344us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.757785 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.759190 (+ 1405us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.760891 (+ 1701us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.760892 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.760892 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.761043 (+ 151us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.761232 (+ 189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.761232 (+ 0us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.761232 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.761310 (+ 78us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.761692 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.761693 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.761744 (+ 51us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.761847 (+ 103us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.761957 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":30}
I20260928 20:19:18.762794 15709 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } has no permanent_uuid. Determining permanent_uuid...
I20260928 20:19:18.764757 15563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.756837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53124 (local address 127.24.190.62:41057)
0928 20:19:18.756872 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.756873 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.756881 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:19:18.756944 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.756945 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.756954 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.757012 (+ 58us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.757591 (+ 579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.758316 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.759248 (+ 932us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.759473 (+ 225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.759550 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.761744 (+ 2194us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.761745 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.761746 (+ 1us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.761754 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.763718 (+ 1964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.764047 (+ 329us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.764048 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.764048 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.764113 (+ 65us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.764328 (+ 215us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.764332 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.764333 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.764431 (+ 98us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.764544 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.764645 (+ 101us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.764699 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.60@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:18.770190 15711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.763104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33810)
0928 20:19:18.763160 (+ 56us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.763170 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.763212 (+ 42us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.763326 (+ 114us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.763326 (+ 0us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.763439 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.763469 (+ 30us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.763470 (+ 1us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.764275 (+ 805us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.764276 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.765088 (+ 812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.765092 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.765490 (+ 398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.765491 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.765570 (+ 79us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.765952 (+ 382us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.765958 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.767357 (+ 1399us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.769110 (+ 1753us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.769112 (+ 2us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.769112 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.769362 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.769573 (+ 211us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.769574 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.769574 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.769651 (+ 77us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.769889 (+ 238us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.769890 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.769945 (+ 55us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.770027 (+ 82us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.770121 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":41}
I20260928 20:19:18.770453 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.763165 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33810 (local address 127.24.190.60:35421)
0928 20:19:18.763206 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.763209 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.763218 (+ 9us) server_negotiation.cc:407] Connection header received
0928 20:19:18.763245 (+ 27us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.763246 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.763257 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.763323 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.763539 (+ 216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.764200 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.765163 (+ 963us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.765418 (+ 255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.765492 (+ 74us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.767438 (+ 1946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.767440 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.767440 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.767447 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.769014 (+ 1567us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.769451 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.769452 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.769452 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.769503 (+ 51us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.769722 (+ 219us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.769722 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.769723 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.769819 (+ 96us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.769870 (+ 51us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.770215 (+ 345us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.770346 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":25}
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.24.190.61@KRBTEST.COM
I20260928 20:19:18.772334 15709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: Bootstrap starting.
I20260928 20:19:18.773413 15709 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:18.773767 15709 log.cc:824] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:18.774037 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.765608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37762 (local address 127.24.190.61:46661)
0928 20:19:18.765649 (+ 41us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.765651 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.765659 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:19:18.765679 (+ 20us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.765680 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.765688 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.765742 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.766444 (+ 702us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.766882 (+ 438us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.767755 (+ 873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.768058 (+ 303us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.768137 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.771201 (+ 3064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.771203 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.771203 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.771210 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.772887 (+ 1677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.773224 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.773225 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.773225 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.773288 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.773475 (+ 187us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.773476 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.773476 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.773632 (+ 156us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.773803 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.773846 (+ 43us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.773921 (+ 75us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21}
I20260928 20:19:18.774683 15709 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: No bootstrap required, opened a new log
I20260928 20:19:18.775161 15559 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } attempt: 2
I20260928 20:19:18.775637 25336 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260928 20:19:18.776685 15709 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.776866 15709 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54cb6757dca242438f6b2ef33638d378, State: Initialized, Role: FOLLOWER
I20260928 20:19:18.776958 15709 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.777221 15715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.777289 15709 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:18.777384 15715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.776813 15533 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "adcb0535b86e41dda1598470f3a63e5b"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53124
W20260928 20:19:18.779265 15726 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:18.779321 15726 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.62@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:18.779713 15641 master_runner.cc:186] Error getting master registration for 127.24.190.62:41057: OK, instance_id { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" instance_seqno: 1790626758428603 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:19:18.782955 15641 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:19:18.783034 15562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.775400 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33824)
0928 20:19:18.775450 (+ 50us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.775460 (+ 10us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.775498 (+ 38us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.775654 (+ 156us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.775655 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.775830 (+ 175us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.775878 (+ 48us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.775881 (+ 3us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.776706 (+ 825us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.776707 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.777476 (+ 769us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.777480 (+ 4us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.777834 (+ 354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.777835 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.777916 (+ 81us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.778397 (+ 481us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.778402 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.779891 (+ 1489us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.781753 (+ 1862us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.781754 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.781755 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.781981 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.782246 (+ 265us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.782247 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.782247 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.782366 (+ 119us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.782705 (+ 339us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.782707 (+ 2us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.782769 (+ 62us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.782830 (+ 61us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.782928 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":33}
I20260928 20:19:18.783324 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.775434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33824 (local address 127.24.190.60:35421)
0928 20:19:18.775508 (+ 74us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.775510 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.775518 (+ 8us) server_negotiation.cc:407] Connection header received
0928 20:19:18.775548 (+ 30us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.775548 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.775559 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.775650 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.775964 (+ 314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.776626 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.777568 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.777756 (+ 188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.777835 (+ 79us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.779982 (+ 2147us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.779984 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.779984 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.779990 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.781648 (+ 1658us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.782076 (+ 428us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.782077 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.782077 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.782160 (+ 83us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.782445 (+ 285us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.782446 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.782446 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.782603 (+ 157us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.782663 (+ 60us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.783178 (+ 515us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.783251 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260928 20:19:18.784759 15559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b: Bootstrap starting.
I20260928 20:19:18.785439 15559 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:18.785742 15559 log.cc:824] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:18.786576 15559 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b: No bootstrap required, opened a new log
I20260928 20:19:18.787896 15559 raft_consensus.cc:348] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.788033 15559 raft_consensus.cc:729] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adcb0535b86e41dda1598470f3a63e5b, State: Initialized, Role: FOLLOWER
I20260928 20:19:18.788102 15559 consensus_queue.cc:260] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.788400 15559 sys_catalog.cc:564] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:18.788415 15533 raft_consensus.cc:482] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260928 20:19:18.788374 15729 sys_catalog.cc:455] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.788522 15729 sys_catalog.cc:458] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.788481 15533 raft_consensus.cc:3037] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:18.789450 15533 raft_consensus.cc:504] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.789723 15533 leader_election.cc:288] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [CANDIDATE]: Term 1 election: Requested vote from peers 6f3a97f55e29429ba7e47ce6711ed79a (127.24.190.61:46661), 54cb6757dca242438f6b2ef33638d378 (127.24.190.60:35421)
I20260928 20:19:18.790321 15683 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "adcb0535b86e41dda1598470f3a63e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "54cb6757dca242438f6b2ef33638d378"
I20260928 20:19:18.790452 15683 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:18.791308 15683 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adcb0535b86e41dda1598470f3a63e5b in term 1.
I20260928 20:19:18.791754 15510 leader_election.cc:302] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54cb6757dca242438f6b2ef33638d378, adcb0535b86e41dda1598470f3a63e5b; no voters:
I20260928 20:19:18.791906 15729 raft_consensus.cc:2781] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 1 FOLLOWER]: Leader election won for term 1
I20260928 20:19:18.792057 15729 raft_consensus.cc:686] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [term 1 LEADER]: Becoming Leader. State: Replica: adcb0535b86e41dda1598470f3a63e5b, State: Running, Role: LEADER
I20260928 20:19:18.792156 15729 consensus_queue.cc:237] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
W20260928 20:19:18.791726 15740 catalog_manager.cc:1558] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:18.792609 15740 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:19:18.792574 15746 sys_catalog.cc:455] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: SysCatalogTable state changed. Reason: New leader adcb0535b86e41dda1598470f3a63e5b. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.792790 15746 sys_catalog.cc:458] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:18.791388 15491 master_runner.cc:186] Error getting master registration for 127.24.190.61:46661: OK, instance_id { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" instance_seqno: 1790626758589857 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260928 20:19:18.793856 15491 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260928 20:19:18.794486 15748 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260928 20:19:18.794682 15748 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260928 20:19:18.796136 15683 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [term 1 FOLLOWER]: Refusing update from remote peer adcb0535b86e41dda1598470f3a63e5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:19:18.796438 15729 consensus_queue.cc:1035] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260928 20:19:18.797596 15715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adcb0535b86e41dda1598470f3a63e5b. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.797698 15715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.799544 15746 sys_catalog.cc:455] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.799654 15746 sys_catalog.cc:458] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: This master's current role is: LEADER
I20260928 20:19:18.800107 15715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.800194 15715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378 [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.800439 15752 mvcc.cc:205] Tried to move back new op lower bound from 7334407204026478592 to 7334407204013297664. Current Snapshot: MvccSnapshot[applied={T|T < 7334407204026478592}]
I20260928 20:19:18.801216 15753 mvcc.cc:205] Tried to move back new op lower bound from 7334407204026478592 to 7334407204013297664. Current Snapshot: MvccSnapshot[applied={T|T < 7334407204026478592}]
I20260928 20:19:18.802646 15748 catalog_manager.cc:1347] Generated new cluster ID: c82bf930db6346e19e6608c3021ccb0d
I20260928 20:19:18.802695 15748 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260928 20:19:18.805943 15563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.794526 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53126 (local address 127.24.190.62:41057)
0928 20:19:18.794568 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.794571 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.795143 (+ 572us) server_negotiation.cc:407] Connection header received
0928 20:19:18.795286 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.795287 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.795309 (+ 22us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.795339 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.796816 (+ 1477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.797572 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.799293 (+ 1721us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.799603 (+ 310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.799645 (+ 42us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.802120 (+ 2475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.802122 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.802122 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.802130 (+ 8us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.804669 (+ 2539us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.805065 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.805067 (+ 2us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.805067 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.805122 (+ 55us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.805319 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.805319 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.805320 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.805463 (+ 143us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.805538 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.805769 (+ 231us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.805849 (+ 80us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22}
I20260928 20:19:18.810647 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.794765 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37764 (local address 127.24.190.61:46661)
0928 20:19:18.794810 (+ 45us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.794812 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.802401 (+ 7589us) server_negotiation.cc:407] Connection header received
0928 20:19:18.802472 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.802474 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.802486 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.802520 (+ 34us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.803158 (+ 638us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.803919 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.804963 (+ 1044us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.805294 (+ 331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.805334 (+ 40us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.807524 (+ 2190us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.807525 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.807525 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.807532 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.809046 (+ 1514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.809623 (+ 577us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.809624 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.809624 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.809682 (+ 58us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.809944 (+ 262us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.809944 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.809945 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.810065 (+ 120us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.810149 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.810453 (+ 304us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.810546 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23}
I20260928 20:19:18.812829 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.794877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33834 (local address 127.24.190.60:35421)
0928 20:19:18.794926 (+ 49us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.794928 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.803323 (+ 8395us) server_negotiation.cc:407] Connection header received
0928 20:19:18.803405 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.803406 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.803430 (+ 24us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.803478 (+ 48us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.804439 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.805159 (+ 720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.806937 (+ 1778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.807314 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.807386 (+ 72us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.809559 (+ 2173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.809561 (+ 2us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.809561 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.809567 (+ 6us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.811186 (+ 1619us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.811896 (+ 710us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.811897 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.811897 (+ 0us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.811985 (+ 88us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.812244 (+ 259us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.812245 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.812246 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.812362 (+ 116us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.812430 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.812646 (+ 216us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.812727 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18}
I20260928 20:19:18.825157 15748 catalog_manager.cc:1370] Generated new certificate authority record
I20260928 20:19:18.825912 15748 catalog_manager.cc:1504] Loading token signing keys...
I20260928 20:19:18.829042 15634 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } attempt: 3
Sep 28 20:19:18 dist-test-slave-n45k krb5kdc[15478](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1790626758, etypes {rep=17 tkt=17 ses=17}, kudu/127.24.190.61@KRBTEST.COM for kudu/127.24.190.60@KRBTEST.COM
I20260928 20:19:18.835971 15748 catalog_manager.cc:5868] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b: Generated new TSK 0
I20260928 20:19:18.836177 15748 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260928 20:19:18.837604 15637 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.829295 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.24.190.60:35421 (local address 127.0.0.1:33846)
0928 20:19:18.829376 (+ 81us) negotiation.cc:107] Waiting for socket to connect
0928 20:19:18.829387 (+ 11us) client_negotiation.cc:174] Beginning negotiation
0928 20:19:18.829424 (+ 37us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0928 20:19:18.829788 (+ 364us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0928 20:19:18.829789 (+ 1us) client_negotiation.cc:394] Received NEGOTIATE response from server
0928 20:19:18.829973 (+ 184us) client_negotiation.cc:189] Negotiated authn=SASL
0928 20:19:18.830022 (+ 49us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.830024 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.831039 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.831040 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.831866 (+ 826us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0928 20:19:18.831868 (+ 2us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.832397 (+ 529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.832398 (+ 1us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0928 20:19:18.832468 (+ 70us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.832948 (+ 480us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0928 20:19:18.832953 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0928 20:19:18.834424 (+ 1471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0928 20:19:18.836526 (+ 2102us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.836527 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.836528 (+ 1us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.836749 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.836968 (+ 219us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0928 20:19:18.836969 (+ 1us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0928 20:19:18.836969 (+ 0us) client_negotiation.cc:760] calling sasl_client_step()
0928 20:19:18.837028 (+ 59us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0928 20:19:18.837286 (+ 258us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0928 20:19:18.837287 (+ 1us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0928 20:19:18.837346 (+ 59us) client_negotiation.cc:769] Sending connection context
0928 20:19:18.837410 (+ 64us) client_negotiation.cc:240] Negotiation successful
0928 20:19:18.837503 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260928 20:19:18.838249 15713 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:18.829493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33846 (local address 127.24.190.60:35421)
0928 20:19:18.829616 (+ 123us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.829618 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.829625 (+ 7us) server_negotiation.cc:407] Connection header received
0928 20:19:18.829660 (+ 35us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.829660 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.829669 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.830103 (+ 434us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.830157 (+ 54us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.830921 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.831999 (+ 1078us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:18.832291 (+ 292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:18.832655 (+ 364us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:18.834519 (+ 1864us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0928 20:19:18.834520 (+ 1us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0928 20:19:18.834520 (+ 0us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0928 20:19:18.834527 (+ 7us) server_negotiation.cc:922] calling sasl_server_start()
0928 20:19:18.836454 (+ 1927us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.836835 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.836836 (+ 1us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.836837 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.836900 (+ 63us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0928 20:19:18.837097 (+ 197us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0928 20:19:18.837097 (+ 0us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0928 20:19:18.837098 (+ 1us) server_negotiation.cc:967] calling sasl_server_step()
0928 20:19:18.837231 (+ 133us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0928 20:19:18.837297 (+ 66us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:18.838080 (+ 783us) server_negotiation.cc:299] Negotiation successful
0928 20:19:18.838159 (+ 79us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260928 20:19:18.839918 15634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: Bootstrap starting.
I20260928 20:19:18.840651 15634 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: Neither blocks nor log segments found. Creating new log.
I20260928 20:19:18.841001 15634 log.cc:824] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: Log is configured to *not* fsync() on all Append() calls
I20260928 20:19:18.842494 15634 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: No bootstrap required, opened a new log
I20260928 20:19:18.845572 15634 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.845748 15634 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3a97f55e29429ba7e47ce6711ed79a, State: Initialized, Role: FOLLOWER
I20260928 20:19:18.845887 15634 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } }
I20260928 20:19:18.846225 15634 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: configured and running, proceeding with master startup.
I20260928 20:19:18.846354 15608 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "adcb0535b86e41dda1598470f3a63e5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6f3a97f55e29429ba7e47ce6711ed79a"
I20260928 20:19:18.846464 15608 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [term 0 FOLLOWER]: Advancing to term 1
I20260928 20:19:18.847312 15608 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate adcb0535b86e41dda1598470f3a63e5b in term 1.
I20260928 20:19:18.847710 15607 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [term 1 FOLLOWER]: Refusing update from remote peer adcb0535b86e41dda1598470f3a63e5b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260928 20:19:18.848022 15729 consensus_queue.cc:1035] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260928 20:19:18.851522 15770 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260928 20:19:18.851583 15770 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260928 20:19:18.853045 15759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.853133 15759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.853185 15759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: SysCatalogTable state changed. Reason: New leader adcb0535b86e41dda1598470f3a63e5b. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.853236 15759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.853268 15759 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:18.853313 15759 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a [sys.catalog]: This master's current role is: FOLLOWER
I20260928 20:19:18.854846 15773 mvcc.cc:205] Tried to move back new op lower bound from 7334407204185673728 to 7334407204013297664. Current Snapshot: MvccSnapshot[applied={T|T < 7334407204026478592}]
W20260928 20:19:18.873123 15563 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.871617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53140 (local address 127.24.190.62:41057)
0928 20:19:18.871663 (+ 46us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.871666 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.872434 (+ 768us) server_negotiation.cc:407] Connection header received
0928 20:19:18.872542 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.872544 (+ 2us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.872555 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.872586 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.873050 (+ 464us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53140: BlockingRecv error: recv got EOF from 127.0.0.1:53140 (error 108)
Metrics: {"server-negotiator.queue_time_us":23}
W20260928 20:19:18.874119 15713 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.872223 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33858 (local address 127.24.190.60:35421)
0928 20:19:18.872265 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.872267 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.873459 (+ 1192us) server_negotiation.cc:407] Connection header received
0928 20:19:18.873613 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.873614 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.873624 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.873654 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.874056 (+ 402us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:33858: BlockingRecv error: recv got EOF from 127.0.0.1:33858 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 20:19:18.874591 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.871950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37778 (local address 127.24.190.61:46661)
0928 20:19:18.871987 (+ 37us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.871989 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.873334 (+ 1345us) server_negotiation.cc:407] Connection header received
0928 20:19:18.873717 (+ 383us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.873718 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.873728 (+ 10us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.873757 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.874536 (+ 779us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37778: BlockingRecv error: recv got EOF from 127.0.0.1:37778 (error 108)
Metrics: {"server-negotiator.queue_time_us":19}
W20260928 20:19:18.876924 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.876232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37792 (local address 127.24.190.61:46661)
0928 20:19:18.876266 (+ 34us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.876268 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.876430 (+ 162us) server_negotiation.cc:407] Connection header received
0928 20:19:18.876531 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.876532 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.876549 (+ 17us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.876577 (+ 28us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.876879 (+ 302us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37792: BlockingRecv error: recv got EOF from 127.0.0.1:37792 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260928 20:19:18.879870 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.879143 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37796 (local address 127.24.190.61:46661)
0928 20:19:18.879176 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.879177 (+ 1us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.879405 (+ 228us) server_negotiation.cc:407] Connection header received
0928 20:19:18.879495 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.879496 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.879504 (+ 8us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.879531 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.879826 (+ 295us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37796: BlockingRecv error: recv got EOF from 127.0.0.1:37796 (error 108)
Metrics: {"server-negotiator.queue_time_us":17}
W20260928 20:19:18.883635 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.882895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37808 (local address 127.24.190.61:46661)
0928 20:19:18.882927 (+ 32us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.882929 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.883142 (+ 213us) server_negotiation.cc:407] Connection header received
0928 20:19:18.883232 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.883233 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.883242 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.883269 (+ 27us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.883582 (+ 313us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37808: BlockingRecv error: recv got EOF from 127.0.0.1:37808 (error 108)
Metrics: {"server-negotiator.queue_time_us":16}
W20260928 20:19:18.889403 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.888646 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37810 (local address 127.24.190.61:46661)
0928 20:19:18.888681 (+ 35us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.888683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.888908 (+ 225us) server_negotiation.cc:407] Connection header received
0928 20:19:18.889002 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.889002 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.889013 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.889042 (+ 29us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.889359 (+ 317us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37810: BlockingRecv error: recv got EOF from 127.0.0.1:37810 (error 108)
Metrics: {"server-negotiator.queue_time_us":18}
W20260928 20:19:18.899571 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.898620 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37822 (local address 127.24.190.61:46661)
0928 20:19:18.898673 (+ 53us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.898675 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.898958 (+ 283us) server_negotiation.cc:407] Connection header received
0928 20:19:18.899073 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.899074 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.899094 (+ 20us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.899125 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.899511 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37822: BlockingRecv error: recv got EOF from 127.0.0.1:37822 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 20:19:18.917748 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.916824 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37834 (local address 127.24.190.61:46661)
0928 20:19:18.916866 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.916869 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.917158 (+ 289us) server_negotiation.cc:407] Connection header received
0928 20:19:18.917260 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.917261 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.917272 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.917302 (+ 30us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.917688 (+ 386us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37834: BlockingRecv error: recv got EOF from 127.0.0.1:37834 (error 108)
Metrics: {"server-negotiator.queue_time_us":20}
W20260928 20:19:18.952148 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:18.951155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37846 (local address 127.24.190.61:46661)
0928 20:19:18.951203 (+ 48us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:18.951205 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:18.951521 (+ 316us) server_negotiation.cc:407] Connection header received
0928 20:19:18.951631 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:18.951632 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:18.951645 (+ 13us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:18.951676 (+ 31us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:18.952073 (+ 397us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37846: BlockingRecv error: recv got EOF from 127.0.0.1:37846 (error 108)
Metrics: {"server-negotiator.queue_time_us":22}
W20260928 20:19:19.018332 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:19.017523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37854 (local address 127.24.190.61:46661)
0928 20:19:19.017598 (+ 75us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.017601 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.017724 (+ 123us) server_negotiation.cc:407] Connection header received
0928 20:19:19.017760 (+ 36us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.017760 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.017774 (+ 14us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.017828 (+ 54us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:19.018235 (+ 407us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37854: BlockingRecv error: recv got EOF from 127.0.0.1:37854 (error 108)
Metrics: {"server-negotiator.queue_time_us":45}
W20260928 20:19:19.148402 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:19.147546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37856 (local address 127.24.190.61:46661)
0928 20:19:19.147601 (+ 55us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.147603 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.147730 (+ 127us) server_negotiation.cc:407] Connection header received
0928 20:19:19.147857 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.147858 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.147870 (+ 12us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.147947 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:19.148330 (+ 383us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37856: BlockingRecv error: recv got EOF from 127.0.0.1:37856 (error 108)
Metrics: {"server-negotiator.queue_time_us":26}
I20260928 20:19:19.375061 15729 sys_catalog.cc:455] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "adcb0535b86e41dda1598470f3a63e5b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "adcb0535b86e41dda1598470f3a63e5b" member_type: VOTER last_known_addr { host: "127.24.190.62" port: 41057 } } peers { permanent_uuid: "6f3a97f55e29429ba7e47ce6711ed79a" member_type: VOTER last_known_addr { host: "127.24.190.61" port: 46661 } } peers { permanent_uuid: "54cb6757dca242438f6b2ef33638d378" member_type: VOTER last_known_addr { host: "127.24.190.60" port: 35421 } } }
I20260928 20:19:19.375444 15729 sys_catalog.cc:458] T 00000000000000000000000000000000 P adcb0535b86e41dda1598470f3a63e5b [sys.catalog]: This master's current role is: LEADER
W20260928 20:19:19.406622 15639 negotiation.cc:337] Failed RPC negotiation. Trace:
0928 20:19:19.405843 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37864 (local address 127.24.190.61:46661)
0928 20:19:19.405924 (+ 81us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.405926 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.405938 (+ 12us) server_negotiation.cc:407] Connection header received
0928 20:19:19.405971 (+ 33us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.405971 (+ 0us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.405982 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.406051 (+ 69us) server_negotiation.cc:226] Negotiated authn=SASL
0928 20:19:19.406540 (+ 489us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:37864: BlockingRecv error: recv got EOF from 127.0.0.1:37864 (error 108)
Metrics: {"server-negotiator.queue_time_us":49}
I20260928 20:19:19.779793 15726 catalog_manager.cc:1259] Loaded cluster ID: c82bf930db6346e19e6608c3021ccb0d
I20260928 20:19:19.779872 15726 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: loading cluster ID for follower catalog manager: success
I20260928 20:19:19.780893 15726 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: acquiring CA information for follower catalog manager: success
I20260928 20:19:19.781225 15726 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 54cb6757dca242438f6b2ef33638d378: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:19:19.852015 15770 catalog_manager.cc:1259] Loaded cluster ID: c82bf930db6346e19e6608c3021ccb0d
I20260928 20:19:19.852090 15770 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: loading cluster ID for follower catalog manager: success
I20260928 20:19:19.852958 15770 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: acquiring CA information for follower catalog manager: success
I20260928 20:19:19.853292 15770 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6f3a97f55e29429ba7e47ce6711ed79a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260928 20:19:19.922720 15845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:19.919818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37878 (local address 127.24.190.61:46661)
0928 20:19:19.919968 (+ 150us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.919971 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.920059 (+ 88us) server_negotiation.cc:407] Connection header received
0928 20:19:19.920191 (+ 132us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.920192 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.920258 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.920347 (+ 89us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:19.920507 (+ 160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.921022 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.921873 (+ 851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.922079 (+ 206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.922156 (+ 77us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:19.922366 (+ 210us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:19.922477 (+ 111us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:19.922570 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:19.922590 (+ 20us) server_negotiation.cc:299] Negotiation successful
0928 20:19:19.922611 (+ 21us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":127,"thread_start_us":53,"threads_started":1}
I20260928 20:19:19.927124 15851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:19.924575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33864 (local address 127.24.190.60:35421)
0928 20:19:19.924681 (+ 106us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.924683 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.924708 (+ 25us) server_negotiation.cc:407] Connection header received
0928 20:19:19.924767 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.924768 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.924814 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.924902 (+ 88us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:19.924993 (+ 91us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.925482 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.926249 (+ 767us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.926507 (+ 258us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.926593 (+ 86us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:19.926779 (+ 186us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:19.926881 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:19.926965 (+ 84us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:19.927016 (+ 51us) server_negotiation.cc:299] Negotiation successful
0928 20:19:19.927036 (+ 20us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83,"thread_start_us":46,"threads_started":1}
I20260928 20:19:19.931748 15857 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:19.928594 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53150 (local address 127.24.190.62:41057)
0928 20:19:19.928703 (+ 109us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.928706 (+ 3us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.928790 (+ 84us) server_negotiation.cc:407] Connection header received
0928 20:19:19.928845 (+ 55us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.928846 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.928894 (+ 48us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.929019 (+ 125us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:19.929114 (+ 95us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.929752 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.930838 (+ 1086us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.931135 (+ 297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.931197 (+ 62us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:19.931389 (+ 192us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:19.931493 (+ 104us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:19.931573 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:19.931630 (+ 57us) server_negotiation.cc:299] Negotiation successful
0928 20:19:19.931659 (+ 29us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90,"thread_start_us":69,"threads_started":1}
I20260928 20:19:19.931803 15845 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:19.928801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37892 (local address 127.24.190.61:46661)
0928 20:19:19.928843 (+ 42us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.928845 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.928938 (+ 93us) server_negotiation.cc:407] Connection header received
0928 20:19:19.929036 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.929037 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.929048 (+ 11us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.929077 (+ 29us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:19.929243 (+ 166us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.929978 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.931023 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.931318 (+ 295us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.931382 (+ 64us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:19.931527 (+ 145us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:19.931556 (+ 29us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:19.931608 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:19.931709 (+ 101us) server_negotiation.cc:299] Negotiation successful
0928 20:19:19.931731 (+ 22us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20}
I20260928 20:19:19.931815 15851 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0928 20:19:19.929018 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33866 (local address 127.24.190.60:35421)
0928 20:19:19.929051 (+ 33us) server_negotiation.cc:206] Beginning negotiation
0928 20:19:19.929053 (+ 2us) server_negotiation.cc:399] Waiting for connection header
0928 20:19:19.929158 (+ 105us) server_negotiation.cc:407] Connection header received
0928 20:19:19.929246 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0928 20:19:19.929247 (+ 1us) server_negotiation.cc:461] Received NEGOTIATE request from client
0928 20:19:19.929256 (+ 9us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0928 20:19:19.929281 (+ 25us) server_negotiation.cc:226] Negotiated authn=TOKEN
0928 20:19:19.929457 (+ 176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.930127 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.930979 (+ 852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0928 20:19:19.931243 (+ 264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0928 20:19:19.931311 (+ 68us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0928 20:19:19.931452 (+ 141us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0928 20:19:19.931482 (+ 30us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0928 20:19:19.931531 (+ 49us) server_negotiation.cc:1035] Waiting for connection context
0928 20:19:19.931706 (+ 175us) server_negotiation.cc:299] Negotiation successful
0928 20:19:19.931730 (+ 24us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17}
I20260928 20:19:19.933863 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 15491
I20260928 20:19:19.938990 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 15566
I20260928 20:19:19.944005 25336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskJmbe_f/build/release/bin/kudu with pid 15641
2026-09-28T20:19:19Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (2839 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (5697 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (276899 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST